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Abstract 

When  considering  the  formation  control  problem  for  large  number  of  spacecraft,  the  advantages  of 
implementing  control  approaches  with  a  centralized  coordination  mechanism  can  be  outpaced  by 
the  risks  associated  with  having  a  primary  vital  control  unit.  Additionally,  in  formations  with  a 
large  number  of  spacecraft,  a  centralized  approach  implies  an  inherent  difficulty  in  gathering  and 
broadcasting  information  from/to  the  overall  system.  Therefore,  there  is  a  need  to  explore  efficient 
decentralized  control  approaches.  In  this  thesis  a  new  approach  to  spacecraft  formation  control  is 
formulated  by  exploring  and  enhancing  the  recent  results  on  the  theory  of  convergence  to  geometric 
patterns  and  exploring  the  analysis  of  this  approach  using  the  tools  of  contracting  theory. 

First,  an  extensive  analysis  of  the  cyclic  pursuit  dynamics  leads  to  developing  control  laws  useful 
for  spacecraft  formation  flight  which,  as  opposed  to  the  most  common  approaches  in  the  literature, 
do  not  track  fixed  relative  trajectories  and  therefore,  reduce  the  global  coordination  requirements. 
The  proposed  approach  leads  to  local  control  laws  that  verify  global  emergent  behaviors  specified  as 
convergence  to  a  particular  manifold.  A  generalized  analysis  of  such  control  approach  by  using  tools 
of  partial  contraction  theory  is  performed,  producing  important  convergence  results.  By  applying 
and  extending  results  from  the  theory  of  partially  contracting  systems,  an  approach  to  deriving 
sufficient  conditions  for  convergence  is  formulated.  Its  use  is  demonstrated  by  analyzing  several 
examples  and  obtaining  global  convergence  results  for  nonlinear,  time  varying  and  more  complex 
interconnected  distributed  controllers. 

Experimental  results  of  the  implementation  of  these  algorithms  were  obtained  using  the  SPHERES 
testbed  on  board  the  International  Space  Station,  validating  many  of  the  important  properties  of 
this  decentralized  control  approach.  They  are  believed  to  be  the  first  implementation  of  decen¬ 
tralized  formation  flight  in  space.  To  complement  the  results  we  also  consider  a  short  analysis  of 
the  advantages  of  decentralized  versus  centralized  approach  by  comparing  the  optimal  performance 
and  the  effects  of  complexity  and  robustness  for  different  architectures  and  address  the  issues  of 
implementing  decentralized  algorithms  in  a  inherently  coupled  system  like  the  Electromagnetic 
Formation  Flight. 
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Chapter  1 


Introduction 


1.1  Spacecraft  Formation  Flight 

Conceptual  architectures  using  multiple  satellites  to  achieve  a  cooperative  objective  have 
been  extensively  researched  in  recent  years.  The  main  motivation  behind  these  concepts 
is  the  general  opinion  that  a  multi-vehicle  system  could  surpass  the  performance  and  have 
enhanced  characteristics  compared  to  those  of  a  single  unit. 

Among  the  characteristics  of  multi- vehicle  systems,  the  intrinsic  parallelism  of  a  multi¬ 
agent  system  provides  robustness  to  failures  of  single  agents,  and  in  many  cases  can  guarantee 
better  time  efficiency.  Moreover,  it  is  possible  to  reduce  the  total  implementation  and  oper¬ 
ation  cost,  increase  reactivity  and  system  reliability,  and  add  flexibility  and  modularity  as 
compared  to  monolithic  approaches. 

Numerous  applications  of  multi-agent  cooperative  systems  have  been  foreseen  in  surveil¬ 
lance  missions,  demining,  planetary  exploration,  coordinated  attack,  and  some  of  them  have 
been  successfully  implemented  in  ground  robots  [49] ,  unmanned  air  vehicles  [8] ,  autonomous 
underwater  vehicles  [98]  and  satellites  [105].  In  particular  several  applications  have  been 
foreseen  for  multi- agent  technology  in  space  (see  Fig.  1-1). 

In  interferometric  missions,  the  idea  that  multiple  formation  flying  spacecraft  can  obtain 
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better  performance  than  a  structurally  connected  spacecraft  by  achieving  larger  baselines 
and  improved  flexibility  is  exploited.  Several  missions  using  multi-spacecraft  systems  with 
the  science  objective  of  detecting  life  components  in  extra-solar  planets  have  been  proposed. 
Formations  of  up  to  30  spacecraft  have  been  studied  for  the  Stellar  Imager  concept  [9,27]. 

Multi-aperture  telescopes  are  another  possible  application.  In  this  approach,  a  set  of 
vehicles  achieve  improved  optical  performance  and  better  coverage  of  multiple  targets  by 
providing  a  flexible  reconfigurable  system.  Additionally,  enhanced  upgradeability  is  con¬ 
sidered  as  a  projected  advantage  as  modules  could  be  changed  or  added  and  an  assembly 
mission  could  be  performed  in  space  achieving  total  apertures  otherwise  impossible  to  launch 
as  a  monolithic  unit  [81]. 

Another  example  is  synthetic  aperture  radar  (SAR)  missions  for  earth  imaging  and  remote 
sensing.  SAR  is  an  implementation  of  radar  technology  that  uses  many  small  antennas 
distributed  among  two  or  several  spacecraft  instead  of  using  a  single  rotating  antenna,  are 
used  to  sense  the  reflection  of  electromagnetic  wavefronts  off  the  earth.  An  improvement 
of  the  overall  performance  achieved  by  implementing  large  and  variable  baselines  between 
antennas  [13,89]. 

Scientific  missions  for  improved  measurements  of  the  earth’s  magnetosphere  have  also 
been  proposed  which  would  take  advantage  of  acquiring  simultaneous  measurements  of  the 
magnetic  field  at  locations  separated  by  a  few  kilometers  [57]. 

More  recent  multi-satellite  missions  consider  clusters  of  satellites  performing  as  a  frac¬ 
tionated  spacecraft  architecture.  In  that  case,  the  spacecraft  would  interchange  information 
while  maintaining  neighboring  positions  in  a  way  such  that  different  components  that  are 
traditionally  located  in  a  single  satellite  could  be  physically  situated  on  different  satellites 
distributing  functions  among  the  different  vehicles.  This  fractionated  architecture  has  im¬ 
proved  reliability  and  upgradeability,  since  replacement  of  individual  components  would  be 
reduced  to  deorbiting  the  module  to  be  replaced  and  launching  a  new  component  into  the 
configuration  [12,46]. 
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Figure  1-1:  As  research  on  multi- vehicle  missions  evolve,  several  concepts  with  increasing 
number  of  vehicles  have  been  proposed,  left:  TPF-I,  center:  System  F6,  right:  SI.  (source: 
NASA,  DoD) 

Scharf  and  Hadaegh  defined  spacecraft  formation  flying  in  [83]  as  “a  set  of  more  than  one 
spacecraft  whose  dynamic  states  are  coupled  through  a  common  control  law.  In  particular, 
at  least  one  member  of  the  set  must  1)  track  a  desired  state  relative  to  another  member, 
and  2)  the  tracking  control  law  must  at  the  minimum  depend  upon  the  state  of  this  other 
member.” 

This  definition  could  be  relaxed  in  the  sense  that  tracking  a  desired  relative  state  is  a 
restrictive  condition.  For  example,  in  the  case  where  the  mission  objective  can  be  achieved 
by  maintaining  the  vehicles  confined  to  a  given  region  or  holding  some  structural  behavior 
without  tracking  specific  trajectories. 

Multi-agent  systems  are  not  linked  just  through  their  control.  Systems  with  multiple 
actuation  that  have  some  level  of  coordination  can  be  considered  multi-agent  systems.  The 
level  of  interconnection  or  coupling  of  the  elements  in  a  multi-agent  system  may  vary  be¬ 
tween  different  architectures.  One  can  think  for  example  of  the  case  of  multiple  actuators 
and  sensors  in  an  actively  controlled  structure  [50].  The  dynamic  coupling  in  this  case  is 
structural,  that  is,  without  applying  control,  the  state  evolution  of  one  node  depends  on  the 
state  of  some  other.  A  tethered  system  [18],  is  a  structurally  coupled  system  with  a  more 
relaxed  interconnection.  In  this  type  of  system  the  formation  is  linked  through  tethers  which 
imply  kinematic  constraints.  This  makes  the  state  evolution  of  one  vehicle  dependent  on  the 
state  of  some  others.  On  the  other  hand,  the  coupling  can  be  caused  by  the  actuation.  Elec- 
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tromagnetic  formation  flight  technology  uses  electromagnetic  forces  to  control  the  relative 
motion  between  spacecraft.  The  spacecraft  are  not  actually  structurally  connected,  and  thus, 
if  no  electromagnetic  actuation  is  performed,  the  evolution  of  the  state  of  one  vehicle  does 
not  depend  on  any  other.  However,  when  the  electromagnets  are  activated  in  more  that  one 
vehicle  the  evolution  of  the  state  of  one  of  the  vehicles  depends  on  the  state  of  some  of  the 
others.  Additionally,  the  system  could  be  coupled  through  measurements.  If  the  information 
that  an  agent  requires  to  be  able  to  perform  its  task  is  obtained  through  different  agents, 
any  control  law  based  on  that  information  couples  the  system.  Finally,  the  interconnection 
between  vehicles  can  be  given  by  the  mission  objective  pursued  by  the  control  system.  If 
the  objective  is  determined  with  respect  to  relative  states,  like  the  case  of  formation  flight, 
even  if  the  system  is  decoupled  in  every  other  manner,  the  system  is  coupled  through  its 
performance. 

Control  strategies  have  been  classically  categorized  into  centralized  approaches,  and  de¬ 
centralized  approaches.  A  centralized  approach  is  an  implementation  where  a  “central” 
computation  unit  (not  necessarily  on  one  of  the  spacecraft)  has  access  to  all  the  states  of 
the  system  and  has  the  capability  to  communicate  the  optimal  control  commands  to  each 
actuator  in  the  overall  system  [10].  This  can  be  considered  in  terms  of  design,  the  simplest 
architecture  to  achieve  optimal  performance. 

In  a  decentralized  scheme,  each  vehicle  has  available  only  partial  information  of  the 
formation  and  decides  its  own  actuation  command  at  each  period.  The  information  available 
to  each  vehicle  can  be  implemented  in  the  form  of  measurements  or  communication.  The 
problem  of  synthesizing  decentralized  controllers  for  an  arbitrary  interconnection  topology 
is  an  open  problem,  and  several  approaches  to  deriving  control  laws  have  been  studied  in  the 
last  30  or  40  years.  The  sub  optimality  arises  given  the  knowledge  of  only  partial  information. 
Different  instantiations  of  a  coordination  state  can  coexist  in  different  vehicles  and  thus,  what 
is  optimal  for  one  instantiation  is  not  necessarily  optimal  for  a  different  vehicle. 

However,  decentralization  has  several  important  features  that  could  largely  impact  the 
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realization  of  a  mission.  Some  of  the  most  important  features  of  decentralized  control  and 
estimation  which  are  especially  applicable  to  space  systems  are: 

•  Launch  and  deployment  independence, 

•  Robustness  to  failures  and  delays  of  a  central  unit, 

•  Module  repeatability, 

•  Simplified  addition  and  rejection  of  modules. 

Moreover,  for  decentralized  implementations  that  only  require  local  information,  decentral¬ 
ization  has  additional  advantages  in  the  sense  of: 

•  Linear  dependence  of  the  communication  complexity  with  the  number  of  vehicles, 

•  Simplicity  of  implementation,  especially,  a  reduced  order  of  the  controller  states 

As  examples,  consider  a  centralized  mission  for  which  the  payload  of  the  central  controller 
fails,  then  the  whole  mission  fails,  or  even  before  launch,  if  its  development  process  is  delayed, 
the  whole  system  is  delayed.  Additionally,  there  is  an  important  inverse  relationship  between 
simplicity  and  reliability.  Decentralized  systems  can  be  simpler  to  implement  and  validate 
because  in  principle,  the  operation  of  each  satellite  does  not  depend  on  the  others. 

Considering  the  interest  in  decentralized  approaches,  the  proposed  thesis  looks  also  at  the 
decentralization  problem  from  a  control  perspective  exploring  a  special  type  of  decentralized 
controller. 

Scharf  et  al.  [83]  identified  the  three  main  areas  that  have  not  been  thoroughly  addressed 
in  the  spacecraft  formation  flight  control  literature:  1)  rigorous  stability  conditions  for  cyclic 
and  behavioral  architectures,  2)  reduced  algorithmic  information  requirements,  and  3)  in¬ 
creased  robustness/ autonomy.  A  control  method  that  exploits  cyclic  topologies  is  studied  in 
this  thesis.  The  general  approach  considers  a  generalization  of  the  cyclic  pursuit  approaches 
and  extends  its  analysis  as  a  manifold  convergence  problem,  which  uses  local  information  to 
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converge  to  global  equilibrium  states  that  are  in  a  manifold.  This  approach  can  efficiently 
address  some  of  these  mentioned  areas. 

This  thesis  explores  the  cyclic-pursuit  based  algorithms  recently  presented  in  the  lit¬ 
erature  because  of  its  fitness  for  space  applications  and  extend  for  application  in  space. 
Additionally,  the  problem  is  studied  under  a  different  theoretical  approach  which  leads  to 
defining  other,  more  general  control  algorithms  and  describe  the  problem  as  convergence 
to  manifolds  with  desired  properties  instead  of  convergence  to  (time  varying)  fixed-point 
trajectories.  Common  approaches  to  formation  control  have  focused  on  the  convergence  to 
fixed  points  of  the  relative  states.  The  research  in  this  thesis  presents  control  algorithms  that 
achieve  convergence  to  manifolds  and  have  valuable  characteristics  including  not  requiring 
coordination  on  specific  relative  positions,  simplicity  of  implementation,  reduced  number  of 
communication  links  (n  links  for  n  agents),  reduced  number  of  computations  to  achieve  a 
formation,  global  convergence,  synchronization,  a  better  fuel  performance  than  other  decen¬ 
tralized  algorithms  and  improved  robustness. 

Another  aspect  considered  in  this  thesis,  strongly  motivated  by  the  decentralization  ob¬ 
jective,  considers  the  extension  and  drawbacks  of  applying  decentralized  control  techniques 
to  an  inherently  coupled  system  such  as  Electromagnetic  Formation  Flight. 

Electromagnetic  Formation  Flight  technology  (EMFF)  is  a  concept  developed  by  the 
Space  Systems  Lab  at  MIT,  also  independently  envisioned  by  Boeing  (Formerly  Hughes 
Aerospace)  and  a  Japanese  research  group  at  the  university  of  Tokyo  [34].  Its  principle 
of  operation  is  the  force  created  by  the  interaction  of  magnetic  fields  generated  by  current 
running  through  High  Temperature  Superconducting  (HTS)  coils.  These  electromagnetic 
coils  generate  fields  equivalent  at  long  distance  to  magnetic  dipoles,  which  can  be  steered 
in  any  three  dimensional  direction  by  the  combination  of  currents  running  through  three 
orthogonal  coils. 

Theoretical  studies  have  demonstrated  the  superiority  of  electromagnetic  formation  flight 
versus  other  propulsion  methods  for  several  applications,  and  a  testbed  has  been  built  and 
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used  to  demonstrate  the  operational  principles  for  control.  Open  loop  control,  position  hold 
and  trajectory  tracking  have  been  successfully  demonstrated  in  a  two-vehicle  configuration. 
EMFF  is  a  maturing  technology  and  due  to  the  complexity  of  the  challenge,  the  control 
approaches  have  considered  only  centralized  techniques.  An  EMFF  system  will  benefit  from 
decentralization  and  this  work  presents  techniques  to  address  the  issue. 

The  main  portion  of  this  work  addresses  the  development  and  validation  of  new  control 
techniques  based  on  the  cyclic  pursuit  approaches  and  its  extensions  based  on  contraction 
theory  and  concluding  sections  perform  a  preliminary  study  the  implications  of  the  proposed 
decentralized  control  approach  and  the  mechanisms  to  implement  it  in  EMFF  systems. 


1.2  Problem  Statement 

Satellite  formation  flight  is  an  enabling  technology  in  the  early  stages  of  its  realization  and 
as  new  applications  are  envisioned,  some  of  them  consider  increasingly  larger  number  of 
spacecraft  achieving  geometric  patterns. 

As  the  number  of  spacecraft  increases  in  a  cooperative  multiagent  system,  the  implemen¬ 
tation  of  centralized  control  approaches  becomes  less  viable,  and  it  is  important  to  identify 
effective  methods  for  decentralized  spacecraft  formation  control.  Most  common  decentralized 
approaches  require  global  coordination  mechanisms,  by  tracking  relative  states  they  constrain 
unnecessary  degrees  of  freedom  and/or  imply  information  transfer  requirements  that  scale 
poorly  with  the  number  of  agents  in  the  formation. 

Mission  objectives  in  several  kinds  of  space  applications,  may  not  require  tracking  specific 
fixed  point  trajectories  of  the  relative  states  but  can  be  achieved  by  maintaining  the  overall 
state  of  the  system  within  a  given  manifold.  Among  several  approaches  to  cooperative  con¬ 
trol,  the  cyclic-pursuit  algorithm,  presents  promising  features;  specifically,  it  has  properties 
of  reduced  information  flow  and  global  convergence  to  manifolds.  The  analysis  of  this  type 
of  controller  can  efficiently  address  areas  in  the  formation  flight  control  field  that  have  not 
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been  thoroughly  explored.  This  approach  could  bring  benefits  to  spacecraft  formation  con¬ 
trol  missions  in  terms  of  reduced  information  requirements,  reduced  fuel  consumption  and 
increased  robustness  and  autonomy.  However,  the  theoretical  results  for  this  algorithm  are 
restricted  so  far  to  the  single  integrator  case,  with  convergence  only  to  circles  or  logarithmic 
spirals  and  precarious  robustness  properties. 

Additionally,  promising  technologies  like  EMFF  systems  are  highly  coupled  through  their 
actuation.  Such  coupling  does  not  allow  for  a  direct  extrapolation  of  decentralized  techniques 
that  do  not  account  for  this  coupling.  Specifically,  the  actuation  in  one  vehicle  requires  at 
least  one  other  vehicle  to  be  actuated,  and  the  fact  that  the  input  command  of  one  vehicle 
affects  all  the  other  active  vehicles. 

1.3  Thesis  Objective 

The  main  objective  of  this  thesis  can  be  summarized  as: 

To  contribute  to  the  field  of  multi- satellite  systems  formation  control  enhancing  the  cur¬ 
rent  state  of  research  in  the  area  of  distributed  controllers.  The  work  in  this  thesis  will  address 
the  development  of  formation  control  algorithms  where  a  global  geometric  behavior  emerges 
from  local  control  rules,  not  based  on  trajectory  tracking,  leading  to  improved  properties  in 
terms  of  complexity  scaling,  global  convergence  and  control  effort. 

Under  the  overall  objective  of  studying  a  new  approach  to  decentralized  spacecraft  for¬ 
mation  control,  the  specific  objective  is  to  develop  control  laws  based  on  the  idea  of  manifold 
convergence,  especially  cyclic  algorithms  for  satellite  formation  flight. 

The  following  subobjectives  are  considered: 

1.  Analysis  of  the  dynamics  of  cyclic  pursuit  algorithms  for  three  dimensional  cases  and 
second  order  dynamics. 

2.  Development  of  controllers  for  the  application  of  the  cyclic  pursuit  approach  in  space¬ 
craft  applications,  namely: 
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(a)  Approaches  considering  low  earth  orbit  dynamics  that  converge  to  near  natural 
relative  orbital  trajectories. 

(b)  Control  approaches  for  deep  space  missions  that  achieve  the  formation  objective 
merely  based  on  relative  information. 

3.  Extension  to  more  complex  interconnection  topologies  and  nonlinear  controllers  to 
improve  the  properties  of  the  cyclic  pursuit  algorithms  and  achieve  more  complex 
objectives,  specifically  by  developing  a  theoretical  approach  to  analyze  the  convergence 
properties  of  more  general  dynamical  systems. 

4.  Experimental  validation  of  the  control  approaches  in  the  SPHERES  testbed  and  anal¬ 
ysis  of  their  properties. 

Additionally,  secondary  objectives  also  addressed  in  this  work  include 

1.  A  framework  to  compare  between  the  interconnection  topology  of  low-level  control 
architectures,  considering  the  system  performance.  Specifically,  focusing  on  comparing 
the  manifold  convergence  methods  to  other  architectures. 

2.  Developing  techniques  to  decentralize  electromagnetic  formation  flight  considering  meth¬ 
ods  for  implementation  of  EMFF  that  do  not  require  the  use  of  centralized  computa¬ 
tion, 


1.4  Approach 

1.4.1  Approach  overview 

The  general  approach  to  address  the  objectives  of  this  thesis  consists  of  exploring  formation 
controllers  inspired  by  the  cyclic  pursuit  algorithm,  extending  and  analyzing  the  applicability 
of  this  approach  for  spacecraft  formation  flight  problem,  and  presenting  a  framework  that 
achieves  a  deeper  approach  to  more  general  dynamic  systems. 
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At  first,  the  analysis  of  the  control  laws  is  based  on  a  linear  eigendecomposition  analysis. 
For  the  basic  cases,  analytical  expressions  for  the  eigenvectors  can  be  derived  given  the  special 
structure  of  the  circulant  matrices  describing  the  underlying  topology.  Then,  a  framework 
considering  results  from  contraction  theory  is  presented.  By  introducing  the  analysis  of  this 
control  algorithms  using  the  framework  of  partial  contraction  theory,  the  control  laws  can 
be  extended  to  more  general  cases  and  obtain  results  for  more  complex  situations. 

The  basic  elements  of  the  control  approach  developed  in  the  thesis  is  framed  by  consider¬ 
ing  the  performance  on  a  benchmark  problem  as  compared  to  other  architectures.  Different 
topologies  are  analyzed  by  defining  a  performance  quadratic  metric  and  cost  metrics  that 
convey  the  cost  of  the  complexity  of  the  implementation  and  the  robustness  to  failures. 

Additionally,  the  analysis  of  some  proposed  techniques  for  the  decentralized  implemen¬ 
tation  of  Electromagnetic  Formation  Flight  are  studied.  The  approach  to  understanding 
the  performance  of  the  techniques  is  through  simulation,  comparing  them  to  a  centralized 
implementation  and  preliminary  analytical  results  describing  their  characteristics. 

1.4.2  A  new  approach  to  formation  flight:  generalized  pursuit 

Following  the  results  in  the  literature  by  Pavone  and  Frazzoli  [67]  and  by  Ren  [76]  this  thesis 
starts  by  considering  the  cyclic  pursuit  approaches  for  achieving  convergence  to  formation 
while  not  tracking  a  specific  trajectory. 

In  the  most  common  approach  to  formation  flight,  the  distributed  control  methods  are 
based  on  tracking  relative  states  with  respect  to  other  vehicles.  For  a  set  of  n  agents  with 
state  described  by  the  variable  Xi,  i  £  {1, ...,  n}.  The  most  basic  description  of  such  approach 


considers  the  system  [60] : 

X*  =  Ui 

(i.i) 

U;  =  ^  hj(xj  -  Xi  -  hij(t )) 

jeM 

(1.2) 
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The  underlying  idea  in  this  case  is  the  fact  that  each  vehicle  tracks  a  position  with  respect 
to  a  set  of  neighbors.  This  problem  is  actually  an  instantiation  of  the  more  general  consensus 
problem  [62],  which  has  been  widely  studied  in  many  other  context,  leading  to  a  wide  array 
of  theoretical  results  extensible  to  the  formation  control  problem.  This  approach  has  been 
later  generalized  to  more  complex  dynamic  cases  [24],  double  integrators  [72], 

On  a  different  approach  to  formation  control,  Pavone  and  Frazzoli  [67]  studied  the  cyclic 
pursuit  control  algorithm,  by  analyzing  the  dynamic  behavior  of  the  system: 


X;  =  kR(a)(xi+ 1  -  Xj),  R(a) 
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where  a  G  [— 7r,  7 r)  is  constant  and  the  overall  dynamics  of  the  n  agents  are  described  as: 


x  =  kAx., 


(1.4) 


A  being  a  block  circulant  matrix. 

The  eigenvalues  and  eigenvectors  of  the  dynamic  matrix  A  can  be  analytically  determined 
based  on  the  special  characteristic  of  the  circulant  matrix  which  defines  the  underlying 
topology. 

The  specific  case  when  a  =  n/n,  leads  to  two  eigenvalues  on  the  imaginary  axis,  which 
determine  the  circular  steady  state  behavior.  If  a  <  1 r/n,  all  the  eigenvalues  are  in  the 
left  hand  plane  which  determines  the  global  convergence  to  a  point.  On  the  other  hand,  if 
the  angle  a  >  v/tl,  two  eigenvalues  will  be  in  the  right  hand  plane  determining  a  unstable 
expanding  spiral  behavior. 

In  a  more  recent  work,  Ren  [74]  extended  these  results  for  more  general  topologies,  by 
considering  the  case: 


x=  £  aijCixj-Xi)  (1.5) 

jeN{i) 
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under  the  same  general  idea,  selecting  C  to  be  a  rotation  matrix  of  angle  9,  the  author 
determines  that  for  a  critical  angle  6C,  two  eigenvalues  can  be  located  on  the  imaginary  axis, 
leading  to  rotating  circular  formations  and  correspondingly  if  the  angle  6  >  6C,  the  right 
hand  eigenvalues  will  imply  an  spiraling  behavior  and  presents  a  first  approach  to  double 
integrators. 

Building  upon  such  ideas,  the  work  on  this  thesis  explores  theoretical  approaches  that 
verify  convergence  characteristics  of  the  more  general  case: 

±i  =  f(x)  +  Uj  (1.6) 

u i  =  ^  fe(x,t)Aj(x,t)(xj-  -Xi)  (1.7) 

jeAf(i) 

by  defining  invariant  manifolds  to  which  convergence  is  shown  using  the  results  from  partial 
contraction  theory. 

The  approach  using  contraction  theory  is  used  for  several  reasons:  First,  an  analytic 
derivation  of  eigenvalues  and  eigenvectors  for  more  complex  topologies  might  not  be  straight¬ 
forward,  second,  it  allows  extensions  to  the  case  of  time  varying  and  nonlinear  controllers. 
This  way,  the  analysis  of  the  controllers  for  more  useful  applications  using  more  complex  for¬ 
mations,  and  showing  global  convergence  properties  for  nonlinear  controllers  can  be  achieved. 

The  general  focus  of  the  theoretical  part  of  this  thesis  is  the  derivation  of  sufficient 
conditions  for  global  convergence  using  the  control  approaches  to  achieve  different  type  of 
geometric  patterns  and  behaviors  without  tracking  relative  trajectories.  Global  convergence 
properties  are  an  important  feature  since  they  guarantee  that  a  stable  formation  is  achieved 
from  any  initial  state.  The  possibly  large  dimensionality  of  the  state,  in  the  case  of  multi¬ 
agent  systems,  makes  global  convergence  an  important  feature  of  the  control  approach.  The 
main  focus  of  the  thesis  is  to  consider  cyclic  topology  and  controllers  derived  from  it,  having 
in  mind  that  this  topology  minimizes  the  number  of  links.  However,  the  idea  of  convergence 
to  manifolds  is  general  enough  and  could  be  extended  to  more  general  interconnections. 
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Avenue  for  further  analytical 
results  in  distributed  control. 


Ch  5.  Comparison  of 
architectures 


Ch.6  Experimental 
demonstration 
In  SPHERES 
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algorithms. 


New  decentralized  control  approach 
for  spacecraft  formation  flight. 


Ch  7.  EMFF 

\  Decentralization  of  particularly 

decentralization 

coupled  propulsion  system. 

Figure  1-2:  Thesis  approach  diagram 

Figure  1-2  illustrate  the  general  flow  of  the  thesis.  The  theoretical  analysis  of  the  pro¬ 
posed  control  approach  is  achieved  by  considering  two  directions.  In  a  first  approach,  an 
eigendecomposition  of  the  cyclic  pursuit  dynamics  is  developed  and  the  required  extensions 
and  results  for  application  in  the  spacecraft  formation  flight  problem  are  derived.  In  a  second 
part  the  analysis  to  more  complex  dynamical  systems  is  extended  by  considering  the  results 
of  contraction  theory.  These  results  define  a  new  path  to  the  analysis  of  the  formation  control 
problem  and  open  new  avenues  of  research  which  is  not  specific  to  the  spacecraft  formation 
flight  problem.  The  validation  of  the  approach  in  a  testbed  on  the  ISS  and  an  analysis  of  the 
advantages  of  such  approach  in  a  specific  benchmark  problem  validate  the  applicability  and 
the  characteristics  of  the  results  of  the  theoretical  work.  Finally,  further  extensions  consider 
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the  implementation  of  decentralized  techniques  in  EMFF  systems. 


1.4. 2.1  Cyclic  pursuit  for  spacecraft  formation  applications 

In  the  first  part  of  the  thesis,  the  cyclic  pursuit  algorithm  is  analyzed  and  exploited  for  appli¬ 
cations  in  spacecraft  formation  flight.  The  same  general  idea  of  identifying  the  eigenvectors 
and  eigenvalues  by  considering  the  properties  of  circulant  matrices  is  used  to  determine  the 
convergence  properties  of  controllers  for  double  integrators.  Second  order  dynamics  are  more 
relevant  to  the  spacecraft  formation  flight  problem. 

For  the  most  basic  case,  the  eigendecomposition  of  the  dynamics  for  a  second  order  system 
with  a  control  law  is  presented,  which  similarly  to  the  approach  presented  by  Ren  [74] ,  require 
an  agreement  on  an  inertial  frame.  In  this  thesis,  the  generalization  to  achieve  control  of  the 
center  of  the  formation  is  also  addressed.  Additionally,  this  controller  includes  a  feedforward 
term  that  makes  the  dynamics  a  straightforward  extrapolation  of  the  first  order  system  and 
allows  for  a  simpler  description  of  the  overall  time  evolution. 

Another  control  algorithm  for  the  case  of  double  integrator  dynamics  which  uses  only 
relative  measurements  to  its  neighbors  is  proposed  and  analyzed  under  the  same  idea  of 
dynamic  eigendecomposition.  In  this  case  it  is  also  shown  that  by  varying  a  set  of  parameters 
the  system  can  be  setup  to  converge  to  Archimedean  spirals,  logarithmic  spirals  and  circles. 

The  idea  is  extended  to  achieve  more  interesting  configurations  by  considering  a  similarity 
transformation.  The  control  law  on  each  vehicle  uses  a  transformation  of  the  cyclic  pursuit 
that  in  the  transformed  space  achieves  circular  formations,  but  in  the  actual  physical  space 
the  trajectories  are  not  necessarily  so.  A  simple  application  of  this  approach  is  shown  to  be 
a  similarity  transformation  of  the  trajectories  which  converges  to  elliptical  trajectories.  The 
importance  of  converging  to  elliptical  trajectories  is  the  fact  that  for  near  circular  low  earth 
orbits,  ellipses  are  near-natural  relative  trajectories.  This  situation  is  exploited  to  consider 
controllers  that  can  be  used  to  achieve  global  formation  acquisition  and  maintenance  in 
the  same  lines  of  the  cyclic  pursuit  algorithm  which  do  not  track  relative  trajectories  but 
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converge  to  the  manifold  of  trajectories  that  are  near-natural  and  require  a  reduced  control 
effort  to  be  maintained. 

A  last  improvement  in  exploring  the  cyclic  pursuit  algorithm  via  a  linear  analysis,  aimed 
to  enhance  the  implementation  of  cyclic  pursuit  approaches  for  spacecraft  formation  flight  is 
related  to  its  robustness.  In  the  cyclic-pursuit  approach,  cyclic  trajectories  occur  only  when 
two  non-zero  eigenvalues  are  on  the  imaginary  axis  and  all  other  non-zero  eigenvalues  have 
negative  real  parts.  This  makes  the  behavior  not  robust  from  a  practical  point  of  view.  An 
approach  to  address  the  problem  is  using  a  nonlinear  version  of  the  controller. 

Intuitively,  for  a  controller  in  which  if  the  agents  are  “close  to  each  other”  they  will  spiral 
out  by  setting  on  >  n/n;  and  conversely,  if  they  are  “far  from  each  other”,  the  spacecraft  will 
spiral  in  by  setting  o.t  <  n/n.  The  approach  to  the  proof  of  the  local  stability  of  the  systems 
uses  a  sequence  of  coordinate  transformations  such  that  a  formation  is  an  equilibrium  point 
of  the  coordinate  system. 

1.4. 2. 2  Contraction  theory  approach  to  generalized  pursuit 

The  eigendecomposition  approach  to  analyze  the  properties  of  a  system  is  limited  in  its 
nature  to  linear  or  linearized  systems  with  a  very  specific  structure.  With  the  purpose  of 
expanding  the  results  to  nonlinear,  more  complex  interconnections  and  time  varying  cases 
the  tools  of  contraction  theory  are  explored.  In  doing  this,  the  underlying  idea  of  the  cyclic 
pursuit  algorithm  is  generalized  as  a  method  to  achieve  convergence  of  the  formation  to  a 
specified  manifold  and  not  necessarily  to  tracking  a  trajectory. 

Contraction  theory  is  presented  as  a  powerful  method  to  approach  the  convergence  anal¬ 
ysis  of  distributed  control  problems  for  which  methods  like  Lyapunov  functions  might  not 
be  suitable.  In  the  contraction  theory  approach,  the  general  idea  consists  of  showing  the 
negative  definiteness  of  a  projected  Jacobian  matrix  which  encompasses  the  dynamics  of 
an  agreement  subspace.  Showing  the  negative  definiteness  of  a  matrix  in  the  case  of  a  dis¬ 
tributed  system  can  turn  more  attainable  than  demonstrating  the  negativeness  of  a  lyapunov 
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rate,  function  of  multiple  states  that  depend  on  each  other. 

The  results  from  partial  contraction  theory  developed  by  Pham  and  Slotine  [68]  describe 
the  problem  of  convergence  to  an  invariant  manifold  of  the  dynamics  system  as  the  problem 
of  showing  convergence  of  an  auxiliary  system  that  describes  the  dynamics  of  a  component 
perpendicular  to  the  desired  manifold. 

In  a  first  result,  applying  the  contraction  approach  to  a  generalized  version  of  the  cyclic 
pursuit  approach  leads  to  a  generalization  to  time  varying  and  state  dependent  cyclic  con¬ 
trollers,  namely  with  the  structure: 

±i  =  k(x,t)R(x,t)(xi  —  Xj) 
je  M 

Convergence  results  extend  straightforward  to  achieving  polygons,  circular  and  spiral 
rotating  formations,  address  time  varying  and  state  dependent  gains  and  coupling  matrices. 

Then,  a  series  of  results  and  corollaries  of  extending  the  contraction  theory  approach  to 
time  varying  subspaces  and  linear  combinations  of  basic  primitives  are  derived.  Specifically, 
a  result  on  the  linear  combination  of  basic  control  functions  shown  to  converge  to  basic 
manifolds  Mi,  which  are  dubbed  ’primitives’,  of  the  form: 


*  =  £*<x) 

i 

such  that: 

Vi : nr  -> RPi ,  V5fi(x)  =  0,  Vi*  =  o,  Vxe 

showing  conditions  for  the  overall  system  to  achieve  convergence  to  the  intersection  of 
the  individual  manifolds,  namely  x->xeAI  =  flAfi.  Several  applications  of  using  these 
results  are  shown  to  illustrate  the  proposed  idea. 
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1.4. 2. 3  Applications  and  experiments 


Another  important  component  of  developing  the  algorithms  presented  in  this  thesis  considers 
the  implementation  of  the  controllers  in  actual  hardware.  The  SPHERES  testbed  is  used  as  a 
platform  to  obtain  experimental  results  for  different  control  laws  derived  from  the  algorithms 
presented  in  this  part  of  the  thesis. 

First,  the  basic  algorithms  were  tested  to  verify  their  performance  and  a  comparison 
to  simulations  is  presented.  In  this  part  the  implementation  of  decentralized  methods  for 
spacecraft  formation  flight  subject  to  the  constraints  of  real  flight  hardware  in  microgravity 
environment  was  validated. 

Additionally,  several  hardware  tests  demonstrated  the  use  of  these  decentralized  control 
algorithms  for  diverse  space  scenarios  foreseeable  in  an  actual  spacecraft  formation  flight 
mission. 

1.4. 2. 4  A  benchmark  problem  framing  the  results 

As  a  concluding  remark  of  the  approach,  in  a  small  section  a  comparison  of  different  control 
architectures  for  formation  flight  is  performed,  highlighting  the  improved  performance  of 
control  algorithms  derived  from  the  generalized  pursuit  approach  in  a  trade  analysis  based 
on  a  benchmark  control  problem.  Some  metrics  were  defined  that  can  be  applied  for  ana¬ 
lyzing  the  different  cases  of  interest.  The  metrics  considers  the  performance  and  competing 
dimensions  that  take  s  into  account  the  complexity  of  implementation  and  the  cost  of  making 
it  robust  to  failures.  Architectures  that  can  address  the  problem  and  for  which  an  optimal 
performance  can  be  calculated  are  studied  and  a  trade  analysis  based  on  the  defined  metrics 
is  done. 


1.4.2. 5  Decentralization  of  EMFF 

As  a  complement  to  the  decentralization  results  in  this  thesis,  the  idea  of  decentralization 
applied  to  a  unique  actuation  system  intended  for  formation  flight  applications  is  considered. 
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Most  of  the  decentralization  techniques  fail  in  their  implementation  for  electromagnetic  for¬ 
mation  flight  due  to  the  fact  that  a  different  type  of  coupling  is  present  in  this  type  of 
system.  With  the  purpose  of  achieving  the  benefit  of  decentralization  in  these  systems,  an 
analysis  of  some  ideas  for  decentralization  of  electromagnetic  formation  is  proposed.  The 
general  approach  in  this  section  is  rather  heuristic  given  the  difficulty  of  the  problem,  and 
some  different  proposed  ideas  are  presented. 

A  natural  approach  for  the  application  of  forces  in  a  decentralized  way  in  a  EMFF 
system  consists  of  decoupling  the  dynamics  of  the  system.  Some  possibilities  are  inspired  on 
the  resource  allocation  schemes  used  in  communication  systems.  In  a  time  divided  resource 
allocation,  the  system  is  decoupled  by  allocating  time  slots  of  operation  for  subsets  of  vehicles. 
During  a  time  slot  the  active  subset  of  vehicles  can  actuate,  and  the  rest  of  vehicles  remain 
’inactive’.  By  alternating  the  set  of  vehicles  that  are  active,  the  desired  forces  can  be  achieved 
under  the  advantage  that  applying  the  closed  loop  control  to  achieve  desired  trajectories, 
the  vehicles  would  need  to  solve  a  set  of  dipole  equations  of  reduced  dimensionality. 

In  a  frequency  divided  resource  allocation  strategy,  subsets  of  vehicles  can  act  simultane¬ 
ously  applying  orthogonal  currents  for  each  different  subset  decoupling  the  actuation.  The 
time  average  interaction  with  vehicles  with  an  orthogonal  frequency  will  be  nulled,  allowing 
for  decoupling  the  interaction  with  vehicles  other  than  the  ones  in  its  own  subset.  Different 
type  of  orthogonal  functions  can  be  more  effective  in  different  situations.  Sine  functions  and 
square  sine  functions  are  studied. 

Another  approach  to  addressing  the  problem  investigates  options  of  a  protocol  for  setting 
up  the  dipoles  in  a  distributed  manner  and  eliminating  the  dependence  in  a  central  unit. 
An  approach  using  a  distributed  protocol  for  the  solution  to  the  dipole  equation  is  proposed 
which  consists  of  defining  a  synchronized  protocol  that  by  calculating  the  local  solution  to  a 
local  optimization  problem  and  sharing  this  solution  value  through  a  communication  network 
achieve  convergence  to  the  global  solution. 
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Chapter  2 


Literature  Review 


In  this  section,  a  short  review  of  some  mathematical  background  and  an  assessment  of  the 
literature  covering  the  topics  concerning  this  thesis  is  presented.  First,  we  present  some 
specific  mathematical  concepts  that  are  of  major  importance  in  this  thesis  and  the  notation 
that  we  use  throughout  the  document. 

The  literature  review  starts  with  a  section  that  presents  the  results  regarding  the  theory 
and  developments  of  decentralized  control.  In  a  second  section,  a  short  description  of  different 
approaches  that  have  been  presented  in  the  context  of  cooperative  control  and  especially 
those  approaches  that  have  been  specifically  presented  for  the  case  of  satellite  cooperative 
flight  will  be  shortly  described.  A  third  section  highlights  papers  that  have  considered  in 
some  extent  the  selection  of  different  interconnection  architectures.  A  fourth  section  presents 
the  literature  describing  the  special  case  of  decentralized  controllers  describing  coordination 
by  cyclic  pursuit  algorithms  and  as  a  last  section  the  developments  and  state  of  the  art  of 
research  on  electromagnetic  formation  flight  technology  will  be  discussed. 


2.1  Background 

In  this  section,  we  provide  some  definitions  and  results  from  matrix  and  graph  theory. 
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2.1.1  Notation 


This  is  the  notation  that  will  be  used  throughout  the  document.  Let  R>0  and  E>0  denote 
the  positive  and  nonnegative  real  numbers,  respectively,  and  denote  as  R(x)  the  real  part(s) 
of  the  complex  element  x.  Let  In  denote  the  identity  matrix  of  size  n:  we  let  AT  and  A* 
denote,  respectively,  the  transpose  and  the  conjugate  transpose  of  a  matrix  A.  A  block 
diagonal  matrix  with  block  diagonal  entries  Ai  is  denoted  diag[A;].  For  an  n  x  n  matrix  A, 
we  let  eig(A)  denote  the  set  of  eigenvalues  of  A,  and  we  refer  to  its  kth  eigenvalue  as  A^, 
k  G  {1, . . . ,  n}  (or  simply  as  A*,  when  there  is  no  possibility  of  confusion).  Also  denote  as 
A  max  the  largest  eigenvalue  such  that  R(Amax)  >  R(A*)  for  all  k. 

The  state  of  a  single  agent  i  is  denoted  by  Xi  which  in  general  x*  G  R2  and  the  overall 
state  of  the  system  will  be  denoted  as  x  =  [xf ,  xfl. . . . ,  xfffl .  Additionally,  let  j  =  y/—l. 

In  general  we  consider  a  matrix  A  to  be  positive  definite  if  X(A+AT),k  >  0  for  all  k  and 
denote  it  as  A  >  0.  Similarly,  a  matrix  A  is  said  to  be  positive  semi-definite  if  A^+j4t)  > 

and  is  denoted  as  A  >  0 

Definition  2.1.1  Flow-invariant  manifolds 

A  flow  invariant  manifold  M.  of  a  system  x  =  /(x)  is  a  manifold  such  that  if  x(t0)  €  M.  then 
x(f  >  tQ)  G  A4.  In  this  work  flow  invariant  manifolds  that  can  described  as  the  nullspace  of 
a  smooth  operator  x  G  M  =>  V(x,  t)  =  0,  jf(V(x,£))  =  0  are  considered. 


2.1.2  Kronecker  product 


Let  A  and  B  be  m  x  n  and px  q  matrices,  respectively.  Then,  the  Kronecker  product  A ® B 
of  A  and  B  is  the  mp  x  nq  matrix 


A®B  = 


a\\B  . . .  a\nB 


& m\B  ■  ■  ■  Q"mn$ 
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If  A .4  is  an  eigenvalue  of  A  with  associated  eigenvector  uA  and  A B  is  an  eigenvector  of  B  with 
associated  eigenvector  uB)  then  XA\B  is  an  eigenvalue  of  A  <E>  B  with  associated  eigenvector 
vA  ®  vB.  Moreover:  (A  ®  B)(C  <8>  D)  =  AC  (g)  BD,  where  A,  B,  C  and  D  are  matrices  with 
appropriate  dimensions. 


2.1.3  Determinant  of  block  matrices 

If  A,  B,  C  and  D  are  matrices  of  size  n  x  n  and  AC  =  CA,  then: 

=  det{AD-CB).  (2.1) 

A  rotation  matrix  is  a  real  square  matrix  whose  transpose  is  equal  to  its  inverse  and  whose 
determinant  is  +1.  The  eigenvalues  of  a  rotation  matrix  in  two  dimensions  are  where  a 
is  the  magnitude  of  the  rotation.  The  eigenvalues  of  a  rotation  matrix  in  three  dimensions  are 
1  and  e±jn,  where  a  is  the  magnitude  of  the  rotation  about  the  rotation  axis;  for  a  rotation 
about  the  axis  (0, 0, 1)T,  the  corresponding  eigenvectors  are  (0, 0, 1)T,  (1,  +j,  0)T(1,  —j,  0)T. 
Denote  R(a )  or  Ra  a  rotation  matrix  of  angle  a. 


det 


/ 


V 


A 

C 


2.1.4  Rotation  matrices 


2.1.5  Circulant  matrices 

A  circulant  matrix  C  is  an  n  x  n  matrix  having  the  form 


Co 

Cl 

c2  ■ 

•  •  cn_ i 

£n— 1  C0 

Cl  • 

Cl 

(2.2) 

Cl 

C2 

■  .  Co 
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The  elements  of  each  row  of  C  are  identical  to  those  of  the  previous  row,  but  are  shifted  one 
position  to  the  right  and  wrapped  around.  The  following  theorem  summarizes  some  of  the 
properties  of  circulant  matrices. 

Theorem  2.1.2  (Adapted  from  Theorem  7  in  [28])  Every  n  x  n  circulant  matrix  C 
has  eigenvectors 


=  ^  (1,  e2^, . . . ,  e^Mn-D/n^  fc  G  {0, 1, . . . ,  n  —  1},  (2.3) 

and  corresponding  eigenvalues 

n— 1 

A  k  =  Y,cre2lTjkp/n’  (2-4) 

p=0 

and  can  be  expressed  in  the  form  C  =  UAU*,  where  U  is  a  unitary  matrix  whose  k-th 
column  is  the  eigenvector  'tpk,  a nd  A  is  the  diagonal  matrix  whose  diagonal  elements  are 
the  corresponding  eigenvalues.  Moreover,  let  C  and  B  be  n  x  n  circulant  matrices  with 
eigenvalues  {A B,k}k=i  and  {^c,k}k=x>  respectively;  then, 

1.  C  and  B  commute,  that  is,  CB  =  BC ,  and  CB  is  also  a  circulant  matrix  with  eigen¬ 
values  eig  (CB)  =  {Ac,fc  AB,ifc}fc=i; 

2.  C  +  B  is  a  circulant  matrix  with  eigenvalues  eig(<7  +  B)  =  {A^a,  +  \B,k}k=i- 

From  Theorem  2.1.2  all  circulant  matrices  share  the  same  eigenvectors,  and  the  same  matrix 
U  diagonalizes  all  circulant  matrices. 

2.1.6  Block  rotational-circulant  matrices 

The  set  of  matrices  that  can  be  written  as  L  <g>  R  where  L  G  R“'v  is  a  circulant  matrix  and 
R  G  K3  is  a  rotation  matrix  about  a  fixed  axis  all  belong  to  a  group  of  matrices  denoted  in 
this  thesis  as  C1Z. 
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Lemma  2.1.3  The  set  CTZ  forms  a  commutative  matrix  algebra.  That  is,  for  any  two  ma¬ 
trices  A,  B  E  CTZ 

1.  A  and  B  commute,  that  is,  AB  =  BA,  and  AB  E  CTZ  with  eigenvalues  eig (AB)  = 
{'W  ^B,k}l=T, 

2.  (A  +  B)  E  CTZ  with  eigenvalues  eig(A  +  B)  =  {A^.fc  +  A B,k}k=i- 

The  proof  is  based  on  the  fact  that  all  CTZ  matrices  are  diagonizable  by  the  same  matrix  T 
of  linearly  independent  eigenvectors  and  is  shown  in  appendix  A.l. 

2.1.7  Graph  representation  of  multi- agent  systems 

This  section  presents  a  short  review  of  the  approach  to  the  description  of  the  interaction 
topology  using  graphs  commonly  used  in  the  literature  of  cooperative  control  (adapted  from 
[771). 

A  weighted  graph  can  be  mathematically  described  of  a  node  set  V  =  {1,  2, . . . ,  n},  an 
edge  set  £  C  V  x  V  and  an  adjacency  matrix  A  =  [ a *j]  E  Knxn. 

The  interaction  topology  of  a  network  of  agents  is  commonly  considered  to  be  represented 
by  a  graph  Q  =  (V,  8),  where  the  set  of  nodes  are  the  vehicles  and  the  edges  denote  the 
interconnection  between  vehicles.  An  edge  (i,j)  denotes  the  fact  that  vehicle  j  can  obtain 
information  regarding  the  state  of  vehicle  i.  For  the  case  of  an  undirected  graph  (i,j)  E  £ 
implies  ( j ,  i)  E  8.  The  weighted  adjacency  matrix  A  is  defined  such  that  is  a  positive 
quantity  if  (j,  i)  E  8  and  0  otherwise. 

A  tree  is  a  graph  such  that  every  node  has  exactly  one  incoming  edge  except  for  one 
node.  A  spanning  tree  is  a  tree  that  reaches  every  node  of  the  graph.  The  neighbors  of  agent 
i  are  denoted  by  H  =  {j  E  V  :  (i,j)  E  £}.  Several  similar  definitions  are  presented  in  the 
literature  for  the  Laplacian  matrix.  Commonly  the  Laplacian  is  defined  as  the  normalized 
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matrix  L  =  [/,;,]  such  that: 


L  = 


hi  —  1 


— _ chi _ 

°*J 


»  #  J 


(2.5) 


L  has  always  a  0  eigenvalue  with  eigenvector  ln,  where  ln  =  {1, 1, 1}  £  Rn  and  it  has 
multiplicity  1  if  and  only  if  the  graph  contains  a  spanning  tree. 


2.1.8  Contraction  theory 

The  work  of  Lohmiller  &  Slotine  [47],  Pham  &  Slotine  [68]  and  Chung  &  Slotine  [19]  have 
laid  the  groundwork  for  the  development  of  control  approaches  based  on  contraction  theory. 
The  main  result  of  contraction  theory  can  be  summarized  in  the  following  theorem: 

Theorem  2.1.4  Contraction  [68]  Consider  in  Rn,  the  deterministic  system 

x  =  f  (x,t)  (2.6) 

where  f  is  a  smooth  nonlinear  function.  Denote  the  Jacobian  matrix  of  f  with  respect  to  x  as 
||.  If  there  exists  a  square  invertible  matrix  @(x,  t)  such  that  0(x,  t)T0(x,  t)  is  uniformly 
positive  definite  and  the  matrix: 

F=  (e  +  e^ofx.t)-1  (2.7) 

is  uniformly  negative  definite,  then  all  the  system  trajectories  converge  exponentially  to  a 
single  trajectory.  The  system  is  said  to  be  contracting. 

Based  on  the  contraction  results,  Pham  and  Slotine  extended  the  theory  to  convergence 
to  flow  invariant  subspaces.  A  main  result  that  defines  the  partial  contraction  theory  is 
presented  [68]  in  the  following: 
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Theorem  2.1.5  Partial  contraction  [68]  Consider  a  flow-invariant  subspace  j\4  and  associ¬ 
ated  orthonormal  projection  matrix  V .  A  particular  solution  xp(t)  of  the  system  2.6  converges 
exponentially  to  M.  if  the  system 


y  =  Vf(VTy,t )  (2.8) 

is  contracting  with  respect  to  y.  If  the  above  condition  is  fulfilled  for  allx.p  then  starting  from 
initial  conditions,  all  trajectories  of  the  system  will  exponentially  converge  to  A4. 

This  last  theorem  is  shown  to  have  important  implications  in  defining  a  framework  for  con¬ 
vergence  to  manifolds,  where  the  positive  definiteness  of  a  projected  Laplacian  is  a  sufficient 
condition  to  show  convergence  to  specific  manifold,  with  results  that  can  be  extended  to 
nonlinear  systems. 

2.1.9  Decentralized  systems  theory 

Fueled  by  research  in  economics,  the  decentralized  control  problem  was  initially  formulated 
by  the  end  of  the  1950’s  and  later  reexamined  in  the  1970’s  in  the  context  of  linear  systems. 
The  work  by  Aoki  [5]  is  one  of  the  first  references  to  discuss  the  stabilization  of  decentralized 
linear  time  invariant  dynamical  systems.  He  defines  decentralized  systems  as  “dynamical 
systems  with  several  controllers,  each  operating  on  the  system  with  partial  information  on 
the  states  of  the  system” . 

Additionally  its  work  mentions  a  key  characteristic  of  this  type  of  systems:  “In  decentral¬ 
ized  systems,  a  realistic  assumption  must  therefore  be  made  that  no  control  agent  possesses 
the  complete  descriptions  of  the  systems  to  be  controlled  and  of  the  environments  in  which 
the  systems  are  to  operate.  Since  each  agent  possesses  a  different  set  of  information  on 
the  true  system  state,  it  is  possible  for  the  system  to  become  unstable  in  the  absence  of 
communication  among  control  agents” . 

The  decentralized  control  theory  deals  essentially  with  the  problem  of  defining  controllers 


41 


Ki  that  stabilize  the  system 


x  =  Ax  +  B{Ui  (2.9) 

Ui  =  CiX  (2.10) 


where  the  information  available  to  it*  is  assumed  to  be: 


k(t)  =  {»(>?). I*i(0  :  V  e  [0>t],C  €  [0,4)} 


(2.11) 


Given  the  classic  motivation  of  the  problem  as  the  interaction  of  a  coupled  system  through 
individual  control  stations,  the  general  problem  considers  coupling  through  the  A,  B  or  C 
matrices  and  is  generally  described  as  the  problem  of  multiple  control  stations. 


In  general  the  theory  of  decentralized  control  has  focused  on  the  problem  where  the  system 
is  interconnected  through  their  non-actuated  dynamics  instead  of  through  the  control. 


It  has  been  long  known  that  the  synthesis  of  controller  for  a  linear  system  under  a 
decentralized  scheme  is  in  general  a  non-convex  problem.  Constraining  the  structure  of 
the  controller  results  in  nonlinear  constraints  that  make  the  problem  non-convex.  Recent 
development  studying  the  optimality  of  decentralized  controllers  have  derived  conditions  on 
the  structure  of  the  problem  that  hold  optimality.  Work  by  Rotkowitz  and  Lall  [80]  has 
proposed  a  property  dubbed  “Quadratic  Invariance” ,  namely  that  KGK  6  S  for  all  K  €  S, 
where  K  and  G  are  the  controller  and  plant  transfer  functions  respectively.  This  property 
is  shown  to  be  a  sufficient  condition  for  convexity  of  the  problem.  A  more  recent  work  by 
Motee  et  al.  [56]  describes  structures  for  which  the  problem  holds  convexity  properties. 
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2.2  Decentralized  Approach  to  Multivehicle  Coopera¬ 
tive  Control 

Several  approaches  have  been  described  in  the  literature  to  design  control  laws  for  achieving 
decentralized  cooperative  control  of  multivehicle  systems,  among  them  navigation  or  po¬ 
tential  functions,  leader  follower  strategies,  behavior  based,  flocking,  graph  description  and 
consensus  mechanisms. 

2.2.1  Potential  functions  and  behavioral  approaches 

The  research  on  potential  functions  approach  is  based  on  the  basic  idea  of  setting  up  a  control 
law  that  is  the  gradient  of  some  potential  (or  navigation)  function  that  has  minimum(a)  at 
the  desired  target(s),  then,  the  equilibrium  is  found  when  a  specific  configuration  is  achieved 
and  the  gradients  of  the  navigation  functions  are  zero. 

One  of  the  seminal  papers  on  navigation  functions  was  presented  by  Koditschek  in  the 
early  1990’s  [37]  and  one  of  the  first  publications  considering  this  methods  in  the  case  of 
a  formation  of  satellites  was  presented  by  Mclnnes  [53].  He  presents  a  cooperative  control 
strategy  for  stationkeeping  a  constellation  of  satellites  in  a  circular  orbit  around  earth.  By 
using  a  scalar  artificial  potential  function  he  shows  the  convergence  to  the  desired  configu¬ 
ration. 

In  the  context  of  cooperative  control,  Ogren  et  al.  [59]  presented  artificial  potential  func¬ 
tions  as  a  method  for  coordination  of  multiple  vehicles.  Olfati-Saber  and  Murray  [64]  intro¬ 
duced  a  more  complete  mechanism  to  define  a  potential  function  approach  that  guarantees 
collision-free  stabilization  of  a  system  of  multiple  vehicles  to  an  unambiguous  formation  based 
on  only  distance  measurements.  More  recent  research  by  Dimarogonas  et  al.  [21-23]  presents 
a  similar  approach  by  defining  navigation  functions  with  sufficient  properties  to  guarantee 
convergence  of  multiple  agents  while  capturing  multi-agent  proximity  situations.  Other  re¬ 
cent  work  [111],  approaches  the  problem  of  maintaining  formation  while  avoiding  obstacles, 
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including  cases  when  the  environment  is  time  varying  [48],  by  using  potential  functions.  Izzo 
and  Petazzi  [30]  also  presented  a  related  work  to  achieve  several  types  of  formations  based 
on  a  behavioral  approach. 

An  approach  similar  in  objective  to  the  initial  part  of  this  thesis  has  been  recently  pre¬ 
sented  by  Sepulchre  et  al.  and  Paley  et  al.  [66,88]  using  a  potential  function  methodology  to 
stabilize  parallel  formations  or  circular  formations.  Their  work  considers  general  intercon¬ 
nection  topologies,  however,  the  analysis  is  restricted  to  dynamics  of  unicycle  agents  with 
constant  speed  and  the  convergence  results  for  their  work  are  only  local. 

2.2.2  Multiple  instantiations  of  the  state 

Another  relevant  topic  presented  in  the  literature  refers  to  addressing  the  cooperative  control 
problem  by  implementing  individual  controllers  on  each  vehicle  based  on  estimation  of  the 
full  state  of  the  formation,  thus  the  control  is  reduced  to  defining  a  MIMO  controller  for  the 
full  state  knowledge  on  each  agent.  In  this  case  the  decentralization  effects  are  not  present 
in  the  controller  but  in  the  state  estimation. 

Several  authors  have  addressed  this  problem  under  different  assumptions.  Carpenter 
[14]  implements  Speyer’s  work  for  the  case  of  formation  flight.  In  Speyer’s  work  [97]  the 
problem  of  defining  optimal  LQG  decentralized  controllers  is  presented  where  the  agents 
share  measurement  and  control  information  with  each  other  and  each  one  produces  its  own 
control  based  on  its  local  Kalman  best  estimate.  An  elaborate  communication  network  where 
a  link  is  drawn  to  every  other  node  forming  a  total  of  n(n  —  l)/2  links  is  considered  with 
the  objective  that  the  controllers  can  be  computed  using  the  best  estimate  of  the  state  of 
the  system  given  the  information  from  all  the  sensors. 

The  work  by  Smith  and  Hadaegh  [93,95],  addresses  the  issue  of  having  on  each  vehicle, 
parallel  estimators  that  calculate  a  best  estimate  of  the  full  state  of  the  system,  but  also  the 
option  of  implementing  equivalent  copies  of  a  centralized  controller  on  each  spacecraft  which 
has  enough  measurements  to  reconstruct  the  state  of  the  formation  [94]. 
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2.2.3  Consensus  problem  and  approach  to  formation  control 


A  more  recent  approach  to  the  cooperative  control  problem  has  arisen  from  the  perspective  of 
consensus.  The  consensus  problem  in  networks  of  agents  describes  the  problem  of  achieving 
agreement  with  respect  to  a  quantity  of  interest  by  exchanging  information  within  other 
agents. 

Olfati-Saber  et  al.  [62, 63]  present  a  very  comprehensive  review  of  the  literature  in  the 
topic.  Here,  we  briefly  discuss  contributions  that  build  up  the  consensus  approach  and  the 
connection  to  the  cooperative  control  problem. 

In  the  most  common  approach  to  formation  flight,  the  distributed  control  methods  are 
based  on  tracking  relative  states  with  respect  to  other  vehicles.  For  a  set  of  n  agents  with 
state  described  by  the  variable  aq,  i  G  {1, ...,  n}.  The  most  basic  description  of  such  approach 
considers  the  system  [60]: 

±i  =  u*  (2.12) 

ui  =  ^2  ~xi~  hij(t ))  (2.13) 

jeMi 

The  underlying  idea  in  this  case  is  the  fact  that  each  vehicle  tracks  a  position  with  respect 
to  a  set  of  neighbors.  This  is  actually  an  instantiation  of  the  consensus  problem  [62]. 

The  consensus  problem  appears  initially  in  the  context  of  distributed  computing  but  has 
become  increasingly  popular  and  has  been  translated  to  many  other  areas  of  research.  This 
framework  is  used  to  address  multiple  related  problems  like  collective  behavior  of  flocks  and 
swarms,  sensor  fusion,  random  networks,  synchronization  of  coupled  oscillators,  algebraic 
connectivity  of  complex  networks,  asynchronous  distributed  algorithms,  formation  control 
for  multi-robot  systems,  optimization-based  cooperative  control,  dynamic  graphs,  complex¬ 
ity  of  coordinated  tasks,  and  consensus-based  belief  propagation  in  Bayesian  networks  (for 
references  of  publications  on  those  topics  refer  to  [62]). 

Among  the  most  commonly  studied  consensus  protocols  is  the  linear  protocol  for  the 
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network  of  n  first  order  systems  Xi  —  Ui%. 


Uj=  ^  hj  (xj(t)  -  Xi(t ))  (2.14) 

jeAfi 

then,  the  dynamics  of  the  overall  system  can  be  written  as: 

x  =  —kLx  (2.15) 

where  L  is  the  graph  Laplacian  in  eq.  2.5.  Since,  ln  is  an  eigenvector  of  the  system,  if  all 
eigenvalues  except  the  zero  eigenvalue  are  in  the  Right  Hand  Plane  (RHP)  and  the  graph  is 
connected,  it  is  straightforward  to  show  that  x  =  (a,  a, ...  ,a)  is  a  solution  to  the  system, 
moreover  it  can  be  shown  that  for  balanced  graphs  a  =  1/N  ccj(0).  An  offset  bi  can 

be  added  to  the  coordinates  such  that  the  equilibrium  reaches  some  desired  relative  states 

Xi  —  Xj  =  bi  —  bj  =  hij . 

This  control  approach  generalizes  to  any  type  of  interconnection  topologies  and  has  been 
widely  studied.  However,  the  coordination  to  formation  is  done  through  the  vector  differences 
hij  =  bj  —  bi  which  need  to  be  coordinated  via  some  mechanism  throughout  the  whole 
formation,  and  constrains  the  formation  to  an  specific  instantiation  of  its  structure. 

Consensus  protocols  for  double  integrators  have  also  been  presented  in  the  literature, 
(modified  from  [77]): 

Xi  =  Ui  (2.16) 

Ui  =  -^kij[{xj{t)-xi{t))  +  1{xj{t)-xi{t))}  (2.17) 

jeM 

The  work  of  Fax  and  Murray  [24]  was  one  of  the  first  introductions  of  the  problem  of  consen¬ 
sus  in  the  context  of  cooperative  control.  The  problem  of  consensus  as  an  alignment  problem 
was  studied  by  Jadbabaie  [31]  in  a  paper  presenting  a  formal  analysis  to  the  flocking  model 
used  by  Vicsek  et  al.  [106]  where  simulations  of  a  simplified  model  were  used  to  study  the 
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self-ordered  motion  in  systems  of  particles  with  biologically  motivated  interaction.  Extend¬ 
ing  Jadbabaie’s  work,  Olfati-Saber  [60]  presented  results  that  connect  results  of  flocking 
behavior  to  the  consensus  problem. 

Moreau  [55]  presented  an  analysis  for  the  specific  case  of  consensus  for  convex  mappings. 
His  idea  generalizes  consensus  results  to  the  most  general  types  of  protocols  that  satisfy  con¬ 
vexity  assumptions.  These  protocols  are  shown  to  embrace  a  great  variety  of  cases  including 
consensus  over  stochastic  matrix  protocols,  nonlinear  synchronization  protocols,  time  vary¬ 
ing  graphs,  swarming  and  flocking  models.  An  extension  to  Moreau’s  work  was  recently 
presented  by  Angeli  and  Blimman  [4]  which  includes  the  possibility  of  arbitrary  bounded 
time-delays  and  relaxes  the  convexity  assumption  to  simply  mappings  that  strictly  decrease 
the  diameter  of  a  set-valued  Lyapunov  function. 

Ren  and  Beard  [71,78]  considered  the  problem  of  information  consensus  in  the  presence 
of  limited  and  unreliable  information  exchange  with  dynamically  changing  topologies  with 
an  important  result,  showing  that,  consensus  can  be  asymptotically  achieved  under  time 
switching  graphs  if  the  union  of  the  directed  interaction  graphs  have  a  spanning  tree  fre¬ 
quently  enough  as  the  time  topology  changes  in  time.  This  result  defines  in  a  more  direct 
way  similar  ones  presented  in  the  results  by  Moreau  [55]  and  Olfati-Saber  [61]. 

In  the  extension  of  consensus  to  the  case  of  second  order  systems  is  presented  by  Ren  and 
Atkins  [74,77],  the  authors  introduced  consensus  protocols  when  knowledge  of  derivatives 
of  the  disagreement  are  available  and  assume  double  integrator  dynamics.  They  show  that 
in  that  case,  unlike  the  first-order  dynamics  case,  having  a  spanning  tree  is  a  necessary 
rather  than  a  sufficient  condition  for  consensus  and  the  cases  of  bounded  control  input,  lack 
of  knowledge  of  relative  velocities  and  partial  knowledge  of  the  reference  state  is  known 
are  considered.  An  important  result  concerning  this  last  case  is  that  consensus  is  reached 
asymptotically  if  and  only  if  the  reference  state  flows  to  all  of  the  vehicles  in  the  team. 

Lafarriere’s  [40]  approach  to  stabilization  of  vehicle  formations  using  the  consensus  ap¬ 
proach  for  second  order  systems  presents  some  parallel  results  considering  a  more  general 
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structure,  showing  a  direct  relationship  between  the  rate  of  convergence  to  the  desired  for¬ 
mation  and  the  eigenvalues  of  the  Laplacian  matrix. 

2.2.4  Contraction  analysis  and  synchronization 

In  an  interesting  more  recent  approach  Chung  and  Slotine  [17, 19]  present  tools  of  contrac¬ 
tion  analysis  to  synthesize  control  laws  that  achieve  synchronized  motion  by  introducing  a 
unified  synchronization  framework  for  cooperative  control  problems.  This  work  considers  an 
approach  similar  to  consensus  while  following  a  desired  trajectory  but  generalizes  the  results 
from  [74]  to  a  much  more  extensive  type  of  dynamical  systems.  In  their  approach,  a  matrix 
dubbed  the  influence  matrix  is  related  to  a  laplacian,  but  it  does  not  have  zero  eigenvalues. 
The  convergence  properties  are  presented  in  terms  of  necessary  conditions  for  contracting 
mappings.  These  results  are  shown  to  be  useful  for  satellite  attitude  coordination  as  well. 

2.2.5  Cyclic  pursuit 

An  approach  that  has  received  recent  attention  in  the  context  geometric  pattern  formation 
is  the  cyclic  pursuit  algorithm.  Such  an  approach  is  attractive  since  it  is  distributed  and 
requires  the  minimum  number  of  communication  links  (n  links  for  n  agents)  to  achieve  a 
formation. 

Justh  et  al.  [33]  presented  two  strategies  to  achieve,  respectively,  rectilinear  and  circle 
formation;  their  approach,  however,  requires  all-to-all  communication  among  agents. 

Lin  et  al.  [45]  exploited  cyclic  pursuit  (where  each  agent  i  pursues  the  next  i+1,  modulo  n) 
to  achieve  alignment  among  agents,  while  Marshall  et  al.  in  [51,52]  extended  the  classic  cyclic 
pursuit  to  a  system  of  wheeled  vehicles,  each  subject  to  a  single  non-holonomic  constraint, 
and  studied  the  possible  equilibrium  formations  and  their  stability. 

Pavone  and  Frazzoli  [67]  developed  distributed  control  policies  for  convergence  to  sym¬ 
metric  formations  for  ground  non-holonomic  robots.  The  key  characteristics  of  that  approach 
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are  the  proof  of  global  stability  and  exponential  convergence  formations,  namely  rendez-vous 
to  a  single  point,  circles,  and  logarithmic  spirals. 

Their  work  consider  n  ordered  mobile  agents  in  the  plane,  with  positions  at  time  t  >  0 
denoted  Xj(t)  =  [xiti (t),xit2(t)]T  G  R2,  i  €  {1,  2, ,  n},  where  agent  %  pursues  the  next  i  +  1 
modulo  n. 

The  dynamics  of  each  agent  are  considered  a  simple  integrator: 


Xi  =  Ui, 

Ui  =  R(ot)(xi+ 1  -Xi), 


(2.18) 


where  R(a),  a  G  [ — 7r,  n),  is  a  rotation  matrix.  They  describe  as  x  =  [xf,  Xj ,  •  •  •  ,  x^]T;  the 
dynamics  of  the  overall  system  which  can  be  written  in  compact  form  as  x  =  A  x,  and  prove 
that: 

Theorem  2.2.1  A(a)  has  exactly  two  zero  eigenvalues,  and 

1.  if  0  <  \a\  <  n/n,  all  non- zero  eigenvalues  lie  in  the  open  left-half  complex  plane; 

2.  if  \a\  =  7r jn,  two  non-zero  eigenvalues  lie  on  the  imaginary  axis,  while  all  other  non¬ 
zero  eigenvalues  lie  in  the  open  left-half  complex  plane; 

3.  ifn/n  <  |a|  <  2tt  jn,  two  non-zero  eigenvalues  lie  in  the  open  right-half  complex  plane, 
while  all  other  non-zero  eigenvalues  lie  in  the  open  left-half  complex  plane; 


After  proving  that  the  matrix  A  is  diagonalizable  it  is  straightforward  to  show  that  agents 
starting  at  any  initial  condition  (except  for  a  set  of  measure  zero)  in  R2n  and  evolving  under 
(2.18)  exponentially  converge: 

1.  if  0  <  |o:|  <  7r fn,  to  a  single  limit  point,  namely  their  initial  center  of  mass; 

2.  if  |ck|  =  7r jn,  to  an  evenly  spaced  circle  formation; 
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3.  if  n  jn  <  \a\  <  2i r/n,  to  an  evenly  spaced  logarithmic  spiral  formation. 

These  results  are  derived  for  agents  operating  in  R2  and  with  a  single-integrator  dynamics, 
(ii)  the  center  of  mass  is  determined  by  the  initial  positions  of  the  agents,  and  (iii)  the  radius 
of  a  circular  formation  is  also  determined  by  the  initial  positions  of  the  agents. 

Ren  [73, 75]  has  recently  presented  and  approach  that  generalizes  this  work  by  consider¬ 
ing  the  problem  as  coordinate  coupling ,  and  representing  the  dynamics  by  using  kronecker 
product  properties.  In  particular,  the  fact  mentioned  in  2.1.2  is  used  and  the  case  of  general 
type  of  interconnections  is  studied  by  analyzing  the  location  of  the  eigenvalues  of  the  system 
L  <g>  R,  where  L  is  the  interconnection  Laplacian  and  R  is  the  rotation  matrix. 

2.2.6  Spacecraft  formation  control 

A  review  of  the  literature  for  the  different  proposed  implementations  of  cooperative  control 
presented  in  the  context  of  spacecraft  cooperative  flight  includes  the  work  detailed  in  this 
section. 

Wang  and  Hadaegh’s  [108]  work  present  one  of  the  first  approaches  to  the  application 
of  cooperative  control  in  the  context  of  the  satellite  formations.  In  this  seminal  work  they 
studied  different  schemes  to  generate  a  desired  formation  and  derived  control  laws  based  on 
nearest  neighbor  tracking,  borrowing  concepts  of  cooperative  control  that  had  been  matu¬ 
rating  on  other  fields,  especially  from  ground  robotics. 

The  work  of  Kapila  et  al.  [36]  studies  leader-follower  configurations  in  the  context  of 
Clohessy-Wiltshire  dynamics.  The  authors  define  control  strategies  based  on  linear  pulsed 
control  where  LQ  or  pole  placement  strategies  are  setup  based  on  the  discrete  state  trans¬ 
formation  matrix  of  the  dynamics.  Their  results  are  mainly  illustrative  simulations  showing 
the  control  performance. 

Kang  et  al.  [35],  proposed  a  different  approach  to  formation  control  derived  from  previous 
approaches  in  the  context  of  ground  robots.  In  their  work,  an  error  function  is  defined  as  a 
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function  of  a  parameter  s.  This  parameter  itself  depends  on  some  function  of  the  state,  for 
example  the  state  of  a  leader  or  more  general  cases  where  the  dependence  is  on  relationships 
of  the  state  of  the  formation.  The  stability  analysis  is  based  on  Lyapunov  methods. 

The  work  by  Folta  and  Quinn  [26]  addresses  the  formation  problem  in  a  more  straight¬ 
forward  implementation  for  a  leader /follower  architecture  defining  intermediate  transition 
states  and  using  state  transition  matrices  to  solve  for  open  loop  8V  impulses  to  reach  the 
next  step  until  eventually  reduce  the  error  to  the  desired  state.  In  [104],  Ulybishev  consid¬ 
ers  an  LQR  design  based  on  the  description  of  a  formation  of  satellites  using  two  planar 
parameters  AV  and  AT  that  describe  the  state  on  a  circular  orbit. 

In  the  work  by  Carpenter  [14, 15],  one  of  the  first  approaches  to  decentralized  formation 
control  is  presented.  In  his  paper,  Speyer’s  framework  [97]  is  applied  to  the  specific  case  of 
formation  of  satellites.  It  is  however  a  very  complete  study  and  presents  a  framework  for 
decentralized  spacecraft  formation  control  to  be  further  studied. 

The  work  by  Beard  et  al.  [6, 7]  presents  an  important  framework  that  generalizes  other 
architectures  by  considering  3  levels  of  control  in  formation  flight  coordination.  Their  con¬ 
sideration  is  that  at  the  highest  level  of  abstraction,  the  agents  must  coordinate  the  subtask. 
At  the  next  level  there  should  be  a  mechanism  to  coordinate  the  motion  of  the  vehicles  to 
achieve  the  desired  objective  of  the  task,  and  at  the  lower  level,  a  controller  that  makes  each 
spacecraft  be  consistent  with  the  desired  coordination  mechanism  is  to  be  implemented.  In 
particular,  Lyapunov  analysis  is  performed  to  define  a  controller  that  would  converge  to 
achieve  the  objective. 

An  interesting  point  is  presented  in  the  work  of  Beard  et  al.  [7]  on  differences  between 
three  approaches  in  the  literature:  “In  leader-following,  coordination  is  achieved  through 
shared  knowledge  of  the  leaders  states.  In  the  behavioral  approach,  coordination  is  achieved 
through  shared  knowledge  of  the  relative  configuration  states.  In  the  virtual  structure  ap¬ 
proach,  coordination  is  achieved  through  shared  knowledge  of  the  states  of  the  virtual  struc¬ 
ture” 
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In  the  work  by  Lawton,  [42,43],  proportional  derivative  controller  approaches  are  derived 
to  achieve  convergence  are  based  on  Lyapunov  analysis.  The  target  locations  are  specified  by 
linear  transformations  which  allow  for  a  clear  presentation  of  their  convergence  properties. 

In  the  work  by  Queiroz  [69],  an  adaptive  control  scheme  is  proposed  for  coordination  of 
multiple  satellites  in  a  Leader/ Follower (s)  architecture. 

The  work  by  Fax  [24, 25]  presents  a  valuable  analysis  of  necessary  conditions  for  stability. 
This  work  is  one  of  the  first  publications  where  a  direct  connection  between  the  information 
topology  and  the  stability  conditions  of  the  system  are  presented.  It  presents  results  which 
define  stability  conditions  in  terms  of  the  eigenvalues  of  the  Laplacian  matrix  when  assuming 
an  identical  copy  of  the  control  used  on  each  vehicle.  At  the  same  time,  Fax’s  work  discusses 
the  importance  of  coordination  as  flow  of  information  in  the  improvement  of  performance. 

The  work  by  Mebashi  and  Hadaegh  [54]  established  important  guidelines  for  Leader/Follower 
assignments  by  expressing  the  information  structure  as  a  directed  graph.  Their  work  re¬ 
stricts  to  a  type  of  “proper  leader/follower  configurations”  where  each  follower  has  at  most 
one  leader.  The  design  of  a  decentralized  controller  design  is  expressed  as  a  LMI  where  the 
particular  structure  of  the  matrix  K  is  considered  and  the  gains  are  obtained  by  solving  a 
Lyapunov  inequality. 

The  work  by  Schaub  and  Alfriend  [84]  considered  impulsive  maneuvers  to  control  orbital 
parameters  in  order  to  maintain  the  formation.  Related  to  this  approach,  the  work  by 
Tillerson  [102, 103]  considers  the  control  of  a  formation  by  solving  a  linear  programming 
problem  to  calculate  the  set  of  impulses  that  minimizes  a  linear  cost  function  while  achieving 
the  final  boundary  conditions. 

In  the  work  by  Smith  and  Hadaegh  [91],  control  using  relative  positions  as  states  was 
studied  and  a  family  of  equivalent  controllers  is  defined  such  that  a  topology  switch  strategy 
can  be  presented.  This  approach  assumes  that  each  vehicle  can  have  enough  knowledge  of 
the  other  vehicles  to  reconstruct  the  full  state  of  the  formation. 

Tanner  at  al.  [99, 100]  studied  the  problem  from  the  perspective  of  input-output  stability 
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from  a  leader  input  to  internal  state  of  the  formation  and  characterizes  the  way  this  input 
affects  stability  performance.  In  a  more  generalized  version  based  on  this  approach  Agikmgse 
et  al.  [1]  formulate  the  problem  of  I/O  stability  via  control  interactions  between  the  space¬ 
craft.  This  formulation  is  shown  to  be  useful  in  characterizing  disturbance  propagation  as  a 
function  of  the  partition  interconnection  topology.  In  their  work,  the  authors  present  a  very 
inclusive  analysis  of  stability  of  formation  with  important  conclusions  regarding  the  perfor¬ 
mance  of  different  architectures.  Necessary  conditions  for  stability  are  presented,  extending 
some  of  the  concepts  of  Input- Output  stability  initially  studied  by  Sontag  and  Wang  [96] 
and  applying  stability  analysis  by  defining  conditions  for  bounded  performance  in  terms  of 
bounded  strictly  increasing  gain  functions  of  the  state  and  the  disturbances.  Additionally, 
they  present  a  frequency  domain  criteria  for  stability  in  terms  of  Linear  Matrix  Inequali¬ 
ties  that  is  proven  helpful  to  identify  stability  and  disturbance  attenuation  in  terms  of  the 
interconnection. 

Ren  [71,  78]  presented  the  idea  of  using  a  decentralized  version  of  the  virtual  structure 
originally  presented  by  [6]  but  proposed  an  implementation  that  would  not  require  a  cen¬ 
tralized  unit,  instead,  the  reference  frame  of  the  formation  would  be  defined  by  agreement 
through  consensus  protocols  using  inter-vehicle  communication. 

In  the  work  of  Chung  [17]  contraction  theory  and  synchronization  approach  is  proposed  for 
achieving  regularly  spaced  spacecraft  formations  in  the  context  of  a  multi-satellite  formation 
with  arbitrary  number  of  spacecraft  converging  into  a  common  time-varying  trajectory. 

2.2.7  Electromagnetic  formation  flight 

The  research  on  electromagnetic  formation  flight  is  relatively  new  and  is  in  an  early  stage 
of  its  development.  It  has  been  proposed  as  a  propellantless  technology  able  to  control  the 
relative  motion  in  a  formation  of  spacecraft  [38] .  Kaneda  et  al.  [34]  also  proposed  and  tested 
the  use  of  electromagnets  to  generate  forces  between  vehicles. 

The  main  equations  that  describe  Electromagnetic  Formation  Flight  (EMFF)’s  principle 
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of  operation  is: 


F  fM  =  (2.19) 

A4* 
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represents  the  electromagnetic  force  caused  by  dipole  j  to  dipole  i,  where  fj.t  is  the  dipole 
vector  generated  by  currents  running  in  the  coils  of  vehicle  i,  fi0  is  the  permeability  constant, 
d ij  is  the  relative  position  vector  between  vehicles  and  F fM  is  the  electromagnetic  force 
acting  vehicle  i.  The  force  on  each  vehicle  is  coupled  to  the  force  on  each  one  of  the  others 
by  its  dependence  on  the  dipoles  of  the  other  vehicles  in  the  formation. 

Kwon  presented  an  analysis  of  its  feasibility  [39] ,  which  demonstrated  favorable  capabili¬ 
ties  in  several  mission  scenarios  as  compared  to  propulsion  systems  that  require  expendables 
for  their  operation. 

The  Space  Systems  Laboratory  at  MIT  has  built  a  2D  testbed  for  this  technology  and 
tested  control  algorithms  that  have  demonstrated  controllability  to  achieve  different  maneu¬ 
vers  [44], 

An  analysis  of  the  dynamics  of  EMFF  and  the  initial  approaches  to  control  strategies  were 
presented  by  Schweighart  and  Ahsun  &  Miller  [2,87].  Ahsun  and  Miller  [3]  presented  an  adap¬ 
tive  control  method  to  deal  with  uncertainties  in  the  model  and  proposed  a  dipole  switching 
strategy  to  deal  with  the  effects  of  Earth  magnetic  field  causing  angular  momentum-build 
up  in  low  Earth  orbiting  systems. 

The  control  strategies  so  far  proposed  require  a  centralized  unit  to  solve  for  the  dipole 
setup  that  achieves  the  desired  forces  by  simultaneously  solving  the  set  of  n  nonlinear  equa- 
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tions.  [3].  In  such  a  control  scheme,  these  equations  are  to  be  solved  at  every  control  period 
and  the  results  are  to  be  communicated  to  each  other  vehicle  in  real  time. 


2.3  Summary  and  Gap  Analysis 

The  decentralized  control  problem  has  been  widely  studied  for  several  decades.  There  is  not 
however,  a  straightforward  answer  to  the  synthesis  of  decentralized  controllers.  Research  in 
the  last  decade  has  considered  the  correlation  between  the  decentralized  control  problem  and 
the  consensus  problem,  a  widely  studied  problem  in  the  literature  in  different  fields.  One 
of  the  most  commonly  accepted  approaches  to  decentralized  formation  flight  control  is  the 
control  of  relative  state  with  respect  to  some  neighbors.  The  basics  of  such  approach  can  be 
analyzed  with  tools  of  consensus  theory. 

However,  a  control  approach  where  there  is  not  a  need  in  coordination  of  the  relative 
offsets  for  each  neighbor  can  be  desired  and  useful  in  many  situations.  Control  approaches 
that  are  not  based  on  tracking  relative  trajectories  while  still  achieving  the  desired  geometry 
have  been  studied.  Some  authors  have  considered  potential  functions,  and  more  recently  a 
cyclic  pursuit  approach  in  the  context  of  ground  robots.  Such  approaches  can  be  useful  for 
the  specific  case  of  formation  flying  space  missions. 

The  most  essential  gap  identified  in  the  literature,  for  which  this  thesis  presents  a  contri¬ 
bution,  is  the  approach  to  design  spacecraft  formation  flight  controllers  not  based  on  relative 
trajectory  tracking  but  on  convergence  to  a  manifold. 

It  is  also  identified  that  as  a  first  step  in  such  direction,  an  extension  of  the  cyclic  pursuit 
to  the  dynamics  of  spacecraft  formation  flight  can  be  used.  All  previous  work  on  cyclic 
pursuit  consider  planar  and  the  analysis  has  been  restricted  to  single  integrator  dynamics. 
As  part  of  extending  the  approach  to  more  useful  applications,  the  extension  to  generalized 
trajectories  and  types  of  formations  are  also  identified  as  missing  elements. 

Another  identified  gap  is  the  lack  of  results  for  global  convergence  approached  to  ’splay- 
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state’  formations,  e.g.  regular  formations  with  equally  spaced  separations  of  a  given  size  and 
the  development  of  a  theoretical  approach  that  can  use  those  results  as  building  block  to 
generalize  the  cyclic  pursuit  approaches. 

And  finally,  the  lack  of  approaches  that  can  be  used  to  decentralize  Electromagnetic 
Formation  Flight  or  reduce  its  dependence  on  a  central  computing  unit. 
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Chapter  3 


Cyclic  Pursuit  Controllers  for 
Spacecraft  Formation  Applications 

3.1  Introduction 

In  the  context  of  formation  flight,  the  problem  of  formation  of  geometric  patterns  is  of  par¬ 
ticular  interest.  Engineering  applications  of  this  problem  include  distributed  sensing  using 
mobile  sensor  networks,  and  space  missions  with  multiple  spacecraft  flying  in  formation,  the 
major  focus  of  this  thesis.  Within  the  robotics  community,  many  distributed  control  strate¬ 
gies  have  been  recently  proposed  for  convergence  to  geometric  patterns  as  was  mentioned 
in  the  literature  review  in  chapter  2.  Several  authors  have  addressed  the  idea  of  using  dis¬ 
tributed  controllers  to  converge  to  patterns,  exploiting  cyclic  pursuit  approaches  (where  each 
agent  i  pursues  the  next  i  +  1,  modulo  n)  with  extension  to  non-holonomic  planar  vehicles, 
and  studied  the  possible  equilibrium  formations  and  convergence  to  patterns  as  equilibrium 
of  artificial  potential  functions. 

The  problem  of  formation  of  geometric  patterns  has  been  the  subject  of  intensive  re¬ 
search  efforts  also  within  the  aerospace  community.  In  an  authoritative  survey  paper  on 
formation  flying  [83],  Scharf  et  al.  propose  a  division  of  formation  flying  architectures  into 
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three  main  classes,  namely:  (i)  Multiple- Input  Multiple-Output  (MIMO),  in  which  the  for¬ 
mation  is  treated  as  a  single  multiple-input,  multiple-output  plant,  (ii)  Leader/Follower,  in 
which  individual  spacecraft  controllers  are  connected  hierarchically,  and  (iii)  cyclic,  in  which 
individual  spacecraft  controllers  are  connected  non-hierarchically.  According  to  Scharf  et  al, 
by  allowing  non- hierarchical  connections  between  individual  spacecraft  controllers,  cyclic  al¬ 
gorithms  can  perform  better  than  Leader/Follower  algorithms,  and  can  distribute  control 
effort  more  evenly.  Moreover,  cyclic  algorithms  are  generally  more  robust  than  MIMO  al¬ 
gorithms,  for  which  a  local  failure  can  have  a  global  effect  [83].  Finally,  cyclic  algorithms 
can  also  be  completely  decentralized  in  the  sense  that  there  is  neither  a  coordinating  agent 
nor  instability  resulting  from  single  point  failures  [83].  The  two  primary  drawbacks  of  cyclic 
algorithms  are  that  the  stability  of  these  algorithms  and  their  information  requirements  are 
poorly  understood  [83];  in  particular,  the  stability  analysis  of  cyclic  algorithms  is  difficult 
since  the  cyclic  structure  introduces  feedback  paths. 

Motivated  by  the  previous  discussion,  the  objective  of  the  work  presented  on  this  chapter 
is  to  consider  a  class  of  cyclic  algorithms  for  formation  flight,  for  which  a  rigorous  stability 
analysis  is  possible  and  for  which  the  information  requirements  are  minimal.  The  starting 
point  is  the  previous  work  by  Pavone  and  Frazzoli  [67],  where  distributed  control  policies 
for  ground  mobile  agents  that  draw  inspiration  from  the  simple  idea  of  cyclic  pursuit  were 
developed  which  guarantee  convergence  to  symmetric  formations.  The  key  features  of  such 
control  laws  [67]  include  global  stability  and  the  capability  to  achieve  a  variety  of  formations, 
namely  rendez-vous  to  a  single  point,  circles,  and  logarithmic  spirals;  moreover,  those  control 
laws  are  distributed  and  require  the  minimum  number  of  communication  links  (n  links  for 
n  agents)  that  a  cyclic  structure  can  have. 

The  organization  of  this  chapter  is  as  follows.  In  Section  3.2.1  we  introduce  basic  concepts 
of  the  cyclic-pursuit  control  laws  for  single-integrator  models  in  two  dimensions.  In  Section 
3.2  we  extend  our  previous  results  along  two  directions:  (i)  in  Section  3.2.1  we  address  the 
case  in  which  agents  move  in  R3  and  it  is  desired  to  control  the  center  of  the  formation,  and 
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(ii)  in  Section  3.2.4  we  study  “robust”  convergence  to  evenly-spaced  circular  formations  with 
a  prescribed  radius.  Then,  in  Section  3.3,  we  extend  our  control  laws  to  double-integrator 
models  in  three  dimensions.  In  particular,  we  develop  control  laws  that  only  require  relative 
measurements  of  position  and  velocity  with  respect  to  the  two  leading  neighbors  in  the  ring 
topology  of  cyclic  pursuit,  and  allow  the  agents  to  converge  from  any  initial  condition  (except 
for  a  set  of  measure  zero)  to  a  single  point,  an  evenly-spaced  circular  formation,  an  evenly- 
spaced  logarithmic  spiral  formation,  or  an  evenly-spaced  Archimedes’  spiral  formation  (an 
Archimedes’  spiral  is  a  spiral  with  the  property  that  successive  turnings  have  a  constant 
separation  distance),  depending  on  some  tunable  control  parameters.  Control  laws  that  only 
rely  on  relative  measurements  are  indeed  of  critical  importance  in  deep-space  missions,  where 
global  measurements  may  not  be  available.  In  Section  3.5  we  discuss  potential  applications, 
including  spacecraft  formation  for  interferometric  imaging  and  convergence  to  zero-effort 
orbits,  and  we  argue  that  Archimedes’  spiral  formations  are  very  useful  symmetric  formations 
for  applications.  Finally,  in  Section  3.6  a  summary  of  the  chapter  and  conclusions  are  drawn. 


3.2  Cyclic-Pursuit  Control  Laws  for  Single-Integrator 
Models 


In  this  section,  we  extend  the  results  in  [67]  in  three  directions:  (i)  we  address  the  case  in 
which  agents  move  in  R3,  (ii)  we  consider  control  of  the  center  of  the  formation,  and  (iii) 
we  study  convergence  to  evenly-spaced  circular  formations  with  a  prescribed  radius.  First 
issues  (i)  and  (ii)  are  addressed. 
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3.2.1  Cyclic  pursuit  in  three  dimensions  with  control  on  the  center 


of  the  formation 


Let  there  be  n  ordered  mobile  agents  in  the  space,  their  positions  at  time  t  >  0  denoted  by 

x;(£)  =  [xi<1(t),xit2(t),xi)3(t)]T  G  M3,  i  E  {1,2, 

and  let  x  =  [xf ,  x;f , . . . ,  x^]T.  The  dynamics  of  each  agent  are  described  by  a  simple  vector 
integrator 

±i  =  kgUi,  kg  G  M>0;  (3.1) 

henceforth,  without  loss  of  generality,  kg  can  be  assumed  to  be  1,  since  it  is  just  a  time 
scaling  factor.  Consider  the  following  three-dimensional  generalization  of  the  cyclic-pursuit 
control  law  in  equation  (2.18): 


Uj  =  i?(o:)(Xi+i  -  Xi)  -  kcXi,  kc  €  E>0, 


(3.2) 


where  R(a),  a  €  [— n,  tt),  is  the  rotation  matrix  (with  rotation  axis  (0, 0, 1)T  without  loss  of 
generality) : 


R(a) 


cos  a  sin  ck  0 

—  sin  a  cos  a  0 

0  0  1 


(3.3) 


The  overall  system  can  be  written  in  compact  form  as 

x=  -(£  +  kcI3n)x, 


(3.4) 
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where  £  =  L\  ®  R(a )  and  L\  is  a  laplacian  for  1-circulant  topology: 


1  -1  0  . 

0  1-10.. 

-1  0  ...  0  1 


(3.5) 


The  analysis  starts  with  the  following  theorem,  that  characterizes  the  spectrum  of  —£. 
Theorem  3.2.1  —  £  has  exactly  three  zero  eigenvalues,  and 

1.  if  0  <  |ai|  <  7r  jn,  all  non-zero  eigenvalues  lie  in  the  open  left-half  complex  plane; 

2.  if  \a\  =  7T jn,  two  non-zero  eigenvalues  lie  on  the  imaginary  axis,  while  all  other  non¬ 
zero  eigenvalues  lie  in  the  open  left-half  complex  plane; 

3.  ifn/n  <  |«|  <  2n fn,  two  non-zero  eigenvalues  lie  in  the  open  right-half  complex  plane, 
while  all  other  non-zero  eigenvalues  lie  in  the  open  left-half  complex  plane. 

Moreover,  L  <S>  R(a)  is  diagonalizable  for  all  a  £  [ — tt,  7 r)  as  described  in  appendix  A.l. 

Proof:  By  the  properties  of  the  Kronecker  product,  the  3n  eigenvalues  of  —  £  are: 


Xk  =  e2njk/n  -  1, 

X+  =  (e2wjk/n  -l)eja,  (3.6) 

A-  =  (e2*jk/n  -  1)  e~ja, 

where  k  G  {1, . . . , n}.  Note  that  for  k  £  {1, ...  ,n  —  1}  the  eigenvalues  Xk  lie  in  the  open  left- 
half  complex  plane,  while  for  k  =  n  we  have  A„  =  0:  moreover,  the  2 n  eigenvalues  {A*}£=1 
are  the  same  as  those  in  Theorem  2.2.1.  Then,  the  claim  follows  from  Theorem  2.2.1.  ■ 

Corollary  3.2.2  When  a  —  n/n,  the  two  eigenvalues  that  lie  on  the  imaginary  axis  are 
=  —j2sm{n/n)  and  Aj"  =  j  2sin(7r/n),  with  corresponding  eigenvectors  an d  th  ■ 
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When  7r jn  <  a  <  2n/n,  the  two  eigenvalues  with  positive  real  part  are  an d  Aj“ ,  with 

corresponding  eigenvectors  gdfi-i  an^  thl  'moreover,  the  real  parts  of  X^_x  and  Xf  are  both 
equal  to  2sin(7r/n)sin(a:  —  n jn). 

Proof:  The  proof  reduces  to  a  straightforward  verification  in  equation  (3.6).  ■ 

Now  the  formations  that  can  be  achieved  with  control  law  (3.2)  can  be  studied.  The  case 
with  kc  =  0  and  the  case  with  kc  >  0  are  separately  studied. 

3.2.2  Case  kc  =  0,  i.e.,  no  control  on  the  center  of  the  formation. 

Combining  Theorem  3.2.1  and  Corollary  3.2.2  (where,  in  particular,  the  eigenvectors  corre¬ 
sponding  to  the  dominant  eigenvalues  are  explicitly  given),  it  is  easy  to  show  (the  arguments 
are  virtually  identical  to  those  in  Section  3.5  of  [67]  and  are  omitted  in  the  interest  of  brevity) 
that  agents  starting  at  any  initial  condition  (except  for  a  set  of  measure  zero)  in  R3n  and 
evolving  under  (3.4)  exponentially  converge: 

1.  if  0  <  |a|  <  7r/n,  to  a  single  limit  point,  namely  their  initial  center  of  mass; 

2.  if  |a|  =  7 r/n,  to  an  evenly  spaced  circle  formation,  whose  radius  is  determined  by  the 
initial  positions  of  the  agents; 

3.  if  n/n  <  |qj|  <  27 r/n,  to  an  evenly  spaced  logarithmic  spiral  formation. 

The  center  of  the  formation  is  determined  by  the  initial  positions  of  the  agents.  Similar 
results  have  recently  appeared  in  [76]. 

Remark  3.2.3  When  kc  =  0,  the  control  law  in  equation  (3.2)  only  requires  the  measure¬ 
ment  of  the  relative  position  (xi+1  —  Xj);  however,  it  uses  a  rotation  matrix  that  is  common  to 
all  agents.  Hence,  control  law  (3.2)  requires  that  all  agents  agree  upon  a  common  orientation, 
but  it  does  not  require  a  consensus  on  a  common  origin. 
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3.2.3  Case  kc  >  0,  i.e.,  control  on  the  center  of  the  formation. 

The  case  kc>  0  is  studied  now;  in  this  case  the  center  of  the  formation  is  no  longer  determined 
by  the  initial  positions  of  the  spacecraft,  instead  it  always  converges,  exponentially  fast,  to 
the  origin.  In  fact,  when  kc>  0  the  eigenvalues  of  —L®R(a)  are  shifted  toward  the  left-hand 
complex  plane  by  an  amount  precisely  equal  to  kc ,  while  the  eigenvectors  are  left  unchanged. 
Then,  the  following  corollary  is  a  simple  consequence  of  Corollary  3.2.2. 

Corollary  3.2.4  Assume  kc  >  0;  then,  if  0  <  |a|  <  n/n,  all  of  the  eigenvalues  are  in  the 
left-hand  complex  plane.  If,  instead,  n/n  <  |ct|  <27 x/n  we  have 

1.  if  kc  >  2s'm(n/n)sm(a  —  Tr/n),  all  of  the  eigenvalues  are  in  the  open  left-hand  complex 
plane; 

2.  if  kc  =  2sin(7r/n)  sin(o;  —  ir/n),  two  non-zero  eigenvalues  lie  on  the  imaginary  axis, 
while  all  other  eigenvalues  lie  in  the  open  left-hand  complex  plane; 

3.  if  kc  <  2sin(7r/n)  sin(o:  —  ir/n),  two  non-zero  eigenvalues  lie  in  the  open  right-hand 
complex  plane,  while  all  other  eigenvalues  lie  in  the  open  left-hand  complex  plane; 

Accordingly,  by  appropriately  selecting  a  and  kc,  the  agents,  starting  at  any  initial  condition 
(except  for  a  set  of  measure  zero)  in  M3n  and  evolving  under  (3.4),  exponentially  converge 
to  the  origin,  or  to  an  evenly  spaced  circle  formation  centered  at  the  origin,  or  to  an  evenly 
spaced  logarithmic  spiral  formation  centered  at  the  origin.  Simulation  results  are  presented 
in  Figure  3-1,  where  7  agents  reach  a  circular  formation  centered  at  the  origin. 

Remark  3.2.5  When  kc  >  0,  the  control  law  in  equation  (3.2)  requires  that  the  agents  agree 
on  a  common  reference  frame  (i.e.,  both  a  common  origin  and  a  common  orientation);  in 
particular,  each  agent  needs  to  measure  its  relative  position  (xz+1  —  x,)  and  know  its  absolute 
position  Xj. 
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Vehicle  trajectories 


30 


Figure  3-1:  Convergence  to  circular  trajectories  centered  at  the  origin.  Left  Figure:  First 
coordinate  as  a  function  of  time  for  each  agent.  Right  Figure:  Trajectories  in  3D. 

Remark  3.2.6  Note  that  the  center  of  the  formation  can  be  chosen  to  be  any  point  in  R3. 
Assume,  in  fact,  that  we  desire  a  formation  centered  at  c  G  R3.  Then,  if  we  modify  the 
control  law  (3.2)  according  to 


u,  =  R(a)(xi+ 1  -  Xj)  -  kc  (xj  -  xc),  kc  G  R>o,  (3.7) 

it  is  immediate  to  see  that  the  center  of  the  formation  will  converge  exponentially  to  xc. 


3.2.4  Convergence  to  circular  formations  with  a  prescribed  radius 

Circular  trajectories  occur  only  when  two  non-zero  eigenvalues  are  on  the  imaginary  axis  and 
all  other  non-zero  eigenvalues  have  negative  real  part,  which  makes  this  behavior  not  robust 
from  a  practical  point  of  view.  In  this  section  we  address  the  problem  of  robust  convergence 
to  a  circular  motion  on  a  circle  of  prescribed  radius  around  the  (fixed)  center  of  mass  of  the 
group,  with  all  agents  being  evenly  spaced  on  the  circle.  Here,  by  robust  we  mean  that  the 
circular  formation  is  now  a  locally  stable  equilibrium  of  a  non-linear  system.  The  key  idea 
is  to  make  the  rotation  angle  a  function  of  the  state  of  the  system. 

Specifically,  let  there  be  n  ordered  mobile  agents  in  the  plane,  their  positions  at  time 
t  >  0  denoted  by  x*(t)  =  [^(t),  xit2(t)]T  G  R2,  i  €  {1,  2, ... ,  n},  where  agent  i  pursues  the 
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next  i  +  1  modulo  n.  The  kinematics  of  each  agent  is  described  by 


X;  K>g  U-2  , 

Uj  =  R{oti)(yLi+i  -  Xi), 

where  the  rotation  angle  is  now  a  function  of  the  state  of  the  system: 


(3.8) 


7T 

o>i  =  -  +  ka  (r  -  ||xi+i  -  Xj ||),  ka,reR>0.  (3.9) 

n 

Without  loss  of  generality,  we  assume  kg  =  1.  In  equation  (3.9)  the  constant  ka  is  a  gain, 
while  r  is  the  desired  inter-agent  distance.  Intuitively,  if  the  agents  are  “close  to  each  other” 
with  respect  to  r,  they  will  spiral  out  since  a*  >  tt/ti:  conversely,  if  they  are  “far  from  each 
other”  with  respect  to  r,  they  will  spiral  in  since  a*  <  tt/ti.  It  is  easy  to  see  that  a  splay  state 
formation  whereby  all  agents  move  on  a  circle  of  radius  r/(2sin(7r/n))  around  the  (fixed) 
center  of  mass  of  the  group,  with  all  agents  being  evenly  spaced  on  the  circle,  is  a  relative 
equilibrium  for  the  system.  The  next  theorem  shows  that  such  equilibrium  is  locally  stable. 


Theorem  3.2.7  A  splay-state  formation  is  a  locally  stable  relative  equilibrium  for  system 
(3.8)  -  (3,9). 

Proof:  A  sequence  of  coordinate  transformations  is  first  considered  such  that  a  splay- 
state  formation  is  indeed  an  equilibrium  point  (and  not  a  relative  equilibrium).  Consider  the 
change  of  coordinates  p j  =  x,+i  —  x*,  i  £  {1, 2, . . . ,  n}.  In  the  new  coordinates,  the  system 
becomes  (the  index  i  is,  as  usual,  modulo  n) 

7 r 

Pi  =  J?(ai+i)  Pi+i  -  R(ot.i)  Pi,  where  Oj  =  -  +  ka  (r  -  ||Pi||).  (3.10) 

n 

By  introducing  polar  coordinates,  i.e.,  by  letting  the  first  coordinate  pit\  =  pz  cos  A;  and  the 
second  coordinate  pit2  =  Qi  sin  i)t ,  with  pi  £  K>0  and  a*  £  E,  the  system  becomes,  after  some 
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algebraic  manipulations  (see  Appendix  A. 2  for  the  details), 

ft  =  Qi+i  cos((i?j+i  -  di)  -  ai+i(gi+i))  -  ft  cos(aj(ft)),  (3-11) 

Pi  =  sin(('dj+1  -  di)  -  o;i+i(ft+1))  +  sin(o;i(ft)),  (3.12) 

Qi 

a*(ft)  =  -  +  ka  (r  ~  Qi),  (3.13) 

Tl 

where  we  have  made  explicit  the  dependence  of  a*  on  ft.  Finally,  by  letting  =  di+i  -  rdl) 
we  obtain 


ft  =  ft+i  cos(<ft  -  cq+i(ft+i))  -  ftcos(aj(ft)),  (3-14) 

pi  =  sin(<ft+1  -  ai+2(ft+2))  +  sin(ai+i(ft+x))  -  sin  ((ft  -  aj+i(ft+i))  -  sin(<ft(ft)), 

ft+l  ft 

(3.15) 

«i(ft)  =  -  +  ka(r  -  Qi).  (3.16) 

Tl > 


Define  g  ^  (ft, . . . ,  gn)T  and  p  =  (ft, ... ,  pn)T\  in  the  new  system  of  coordinates  g- 
p,  a  splay  state  formation  corresponds  to  an  equilibrium  point  g*  =  (r, . . . ,  r)T  and  p*  = 
(^, . . . ,  —  27r^~1^)r.  In  compact  form  we  write 


Q 

P 


=  /(ft  <p)- 


(3.17) 


The  linearization  of  system  (3.17)  around  the  equilibrium  point  ( g*,p *)  is 

ft  =  cos(7r/n)(ft+i  -  Qi)  -  kar  sm(n/n)(gi+1  +  ft)  -  r  sin(7r/n)  ft,  (3.18) 

Pi  =  (&a  cos(7r/n)  +  -  sin(7r/n))(ft+2  -  2ft+i  +  ft)  +  cos(7r/n)(ft+i  -  (pi).  (3.19) 

r 

Without  loss  of  generality  we  set  r  =  1;  the  linearized  system  can  be  written  in  compact 
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form  as 


Q 

djl  2/C Q,  Sn  In 

i 

1 

Q 

=  P 

Q 

V 

bnL\ 

1 

rH 

T 

V 

(3.20) 


wllGfG  Sn  —  sill(7r/7l),  Cfi  —  COs(7T  j  7l),  Ctn  —  (^a'-'n  On);  kaCn~\~  B.Ild.  L\  Is  a  1  CirClllailt 
laplacian  described  in  eq.  3.5.  The  spectrum  of  P  is  characterized  by  the  following  Lemma. 


Lemma  3.2.8  The  matrix  P  has  2n—3  eigenvalues  with  negative  real  part,  and  3  eigenvalues 
with  zero  real  part.  The  eigenvalues  with  zero  real  part  are  Ai  =  0,  and  A2,3  =  ±2js„;  the 
corresponding  eigenvectors  v\ .  V2  and  v3  are: 


V\ 

—  —2k  1  )T 

V  J-7i7  *-jrXja  xn )  i 

(3.21) 

V2 

=  (V'l,  -2 6„ew^1)T, 

(3.22) 

Vz 

=  V2, 

(3.23) 

where  ln  =  (1,1,...,  1)T  E  Rre,  iji  is  the  eigenvector  for  k  =  1  in  equation  (2.3)  and  v 
indicates  the  complex  conjugate  of  v. 

Proof:  The  proof  of  this  lemma  is  presented  in  Appendix  A. 3.  ■ 

System  (3.17)  is  constrained  to  evolve  on  a  subset  of  R2n.  To  see  why  this  is  the  case, 
recall  that  from  the  definition  of  p*  we  have  Y%=\  Pi  —  0,  or  equivalently  fPfi=i  -R($i)Pi  =  0. 
In  polar  coordinates  these  constraints  become  YH=  i  ft  c°s($i  —  $i)  =  0  and  i  ft  sin(i9j  — 
i91)  =  0.  Thus,  in  the  system  of  coordinates  g~(p,  the  following  two  constraints  must  hold  at 
all  time 

X>)=°.  <3-24) 

k= 1  / 

n  /  i— 1  \ 

ft>(ft<A)  =  ^Qi  sin  I  )  =  o.  (3.25) 

i=l  \fc=l  / 


9i(Q,p)  =  ^2  Qi 


cos 


i=l 
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Moreover,  by  definition  of  ip,  the  following  constraint  must  hold  at  all  time 


n 

93{q,  v)  =  ^2  Vi  =  0-  (3.26) 

i=  1 

Let  g(e,<fi)  =  (9i(q,V),92(q,v),93(q,v))T  and  define 

M  =  {(Q,v)e  R2”  :  g(e,  V)  =  0}C  R2ra.  (3.27) 

Note  that  (g*,v*)  £  Ad.  The  Jacobian  of  g(g,v)  evaluated  at  the  equilibrium  point  is 

1  cos(27r/n)  ...  cos(27r(n  -  l)/n)  -  X)"=2  r  sin(27r(*  ~  1)A0  ■■■  ~r  sin(2-7r(n  -  l)/n)  0 

G=  0  sin(27r/rc)  ...  sin(27r(n  -  l)/n)  £"=  2  rcos(2-7r(i  -  l)/n)  ...  rcos(27r(n  -  l)/n)  0  (3.28) 

0  0  ...  0  1  ...  1  i_ 

Let  Bs(g*,v*)  be  the  open  ball  of  radius  S  >  0  centered  at  point  (g* ,  ip*)  in  K2n.  The 
rank  of  G  is  clearly  3;  then,  there  exists  S  >  0  such  that  M  =  M  D  Bs(g*,v*)  C  M2n  is 
a  submanifold  of  R2”.  The  tangent  space  of  M  at  (g*,ip*),  that  we  call  is  an 

invariant  subspace  of  P  (since  M,  by  construction,  is  invariant  under  (3.17),  i.e. ,  f(g,v)  £ 
for  all  (g,v)  £  Ad)  and  has  dimension  2 n  —  3.  Pick  a  basis  {uq, . . . ,  w2n-z}  of 
w>  M.  and  complete  it  to  a  basis  W  of  R2n.  Then,  with  respect  to  this  basis,  P  takes  the 
upper-triangular  form 

P\,\  Pi, 2 

03x(2n-3)  T*2,2 

where  03x(2n-3)  is  the  zero  matrix  with  3  rows  and  2n  —  3  columns.  Since  our  system  is 
constrained  to  evolve,  at  (g*,ip*),-  along  the  tangent  space  T(e»>¥,») Ad,  the  local  stability  of 
the  equilibrium  point  is  solely  determined  by  the  eigenvalues  of  P\t\. 

Now  it  is  shown  that  the  three  eigenvalues  of  P2.2  are  exactly  the  three  eigenvalues  of  P 


(3.29) 
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that  have  real  part  equal  to  zero.  It  is  possible  to  show  (see  Appendix  A. 4)  that 


G  ■  Vi  0,  for  each  i  e  {1,2,  3}, 


where  i  G  {1,2,3},  are  the  three  eigenvectors  associated  to  the  three  eigenvalues  with 
zero  real  part.  Therefore,  we  have  vl  <£  %  G  {1,2,3}.  Let  ^  be  the  components 

of  Vi  with  respect  to  the  basis  W;  define  as  the  vector  of  components  with  respect  to 
{u>i, . . . ,  w2n - 3 }  •  and  yit2  as  the  vector  of  components  with  respect  to  the  remaining  basis 
vectors  in  W.  Since  ty  vector  yij2  is  non-zero.  Since  vt  is  an  eigenvector  of  P 

with  eigenvalue  we  can  write 


PlA 

Pi, 2 

Vi,  1 

=  A 

Vi,  i 

03x(2n-3) 

P 2,2 

Vi,  2 

Vi,  2 

(3.30) 


and  therefore  P2,2yi,2  =  \yi,2 ,  i  e.,  \  is  an  eigenvalue  of  P2> 2,  i  €  {1,2,3}.  Since,  we  have 
eig(Piii)  =  eig(P)  \eig(P2;2),  we  conclude,  by  using  Lemma  3.2.8,  that  all  eigenvalues  of  P1; x 
have  negative  real  part.  Therefore,  the  equilibrium  point  (g*,  tp*)  is  locally  stable.  ■ 


3.3  Cyclic-Pursuit  Control  Laws  for  Double-Integrator 
Models 

In  this  section,  we  extend  the  previous  cyclic-pursuit  control  laws  to  double  integrators.  A 
control  law  is  presented  first,  which  requires  each  agent  to  be  able  to  measure  its  absolute 
position  and  velocity;  then,  the  of  design  a  control  law  that  only  requires  relative  measure¬ 
ments  of  position  and  velocity  is  detailed.  The  approach  to  the  problem  is  done  through 
through  spectral  analysis  to  completely  characterize  the  dynamics  of  the  second  order  sys¬ 
tem.  Particularly,  this  approach  shows  how  the  position  behavior  is  characterized  by  exactly 
the  same  eigenvectors  and  eigenvalues  as  in  the  first  order  system. 
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As  before,  let  x*(t)  =  [xiii(t),xit2(t),xi}3(t)}T  G  E3  be  the  position  at  time  t  >  0  of  the  ith 
agent,  i  G  {1,  2, . . . ,  n},  and  let  x  =  [xf ,  x;f , . . . ,  x^]r.  Moreover,  let  R(a)  be  the  rotation 
matrix  in  three  dimensions  with  rotation  angle  a  G  [ — tt,  7t)  and  rotation  axis  (0,  0, 1)T  (see 
equation  (3.3)). 

Now  the  case  where  the  the  dynamics  of  each  agent  are  described  by  a  double-integrator 
model  is  analyzed: 

X;  =  Uj.  (3.31) 

3.3.1  Dynamic  cyclic  pursuit  with  reference  coordinate  frame 

Consider  the  following  feedback  control  law 


Ui  =  kdR(a)(xi+ 1  -  x<)  +  R{a)(±i+1  -  xj 


kckd  Xj  ( kc  kd)  Xi,  kd  G  E>.q,  kc  G  E. 


(3.32) 


Note  that  each  agent  needs  to  measure  both  its  absolute  position  (if  kc  ^  0)  and  its  absolute 
velocity  (if  kc  ^  —kd).  The  overall  dynamics  of  the  n  agents  are  described  by: 


X 

0  Tin 

X 

kd  A(a)  A(a)  -  kdI3n 

x  =  C(a)  x, 


(3.33) 


where  A{a)  =  —L\  ®  R(a )  —  kcI3n  and  L\  is  the  matrix  defined  in  equation  (3.5).  The 
following  theorem  characterizes  eigenvalues  and  eigenvectors  of  C(a). 


Theorem  3.3.1  Assume  that  -kd  is  not  an  eigenvalue  of  A( a).  The  eigenvalues  of  the  state 
matrix  C(a)  in  equation  (3.33)  are  the  union  of: 

•  the  3n  eigenvalues  of  A{a), 

•  -kd,  with  multiplicity  3 n. 
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In  other  words,  eig(C(a ))  =  eig(A(a ))  U  {—kd}.  Moreover,  the  eigenvector  of  C(a)  corre¬ 
sponding  to  the  kth  eigenvalue  M  G  eig(A(a)),  k  E  { 1, . . .  ,3n},  is: 


I'M 

_ 

P'k 

,  k  3n}, 

(3.34) 

»k,2 

XkP'k 

where  /q0  is  the  eigenvector  of  A(a)  corresponding  to  Xk-  The  3 n  (independent)  eigenvectors 
corresponding  to  the  eigenvalue  —kd  (that  has  multiplicity  3 n)  are 


I'k 


Vk,\ 

k d  & k—3n 

Vk,2 

& k—3n 

,  k  G  {3 n  +  1, . . . ,  6rc}, 


where  ej  is  the  jth  vector  of  the  canonical  basis  in  M3”. 


(3.35) 


Proof:  First,  we  compute  the  eigenvalues  of  C(a).  The  eigenvalues  of  C(a)  are,  by 
definition,  solutions  to  the  characteristic  equation: 


0  =  det 


XI3n 


Izn 


- kdA(a )  A I3n  -  (A(a)  -  kdI3n) 


By  using  the  result  in  equation  (2.1),  we  obtain 


(3.36) 


0  =  det  (A 2/3n  -  A  ( A(a )  -  kdI3n)  -  kd  /1(a)) 

=  det((A  +  kd)I3n )  det(A I3n  -  /1(a)). 

Thus,  the  eigenvalues  of  C(a)  must  satisfy  0  =  det((A  +  kd)I3n)  and  0  =  det(A I3n  —  /1(a)); 
hence,  the  first  part  of  the  claim  is  proved. 
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By  definition,  the  eigenvector  [uf^  z^2]r  corresponding  to  the  eigenvalue  Xk,  k  =  1, . .  ...  6n, 
satisfies  the  eigenvalue  equation: 


24,1 

1 

o 

24,1 

= 

Z4,2 

kdA{a)  A(a)  -  kdI3n 

24,2 

*4,  2 

kd  A(a)vkyi +A(a)uky2  -  kduky2 


Thus,  we  obtain 


Afcf'fc,  1  =  *4,  2, 

Afc^,2  =  &d  ^4(aK,i  +  -4(«)^,2  -  &d  *4, 2, 


and  therefore 


(3.37) 


(3.38) 


(3.39) 

(3.40) 


Afc(fcd  +  Xk)ukyi  —  ( kd  +  Xk)  A(a )  z/^i.  (3-41) 

If  Afc  =  — /erf,  then  we  have  3n  eigenvectors  given  by  [—k^ej,  ef7,  j  =  {l,...,3n}.  If, 
instead,  Xk  E  eig(A(o:))  (note  that  by  assumption  —  kd  ^  eig(/l(a:))),  we  obtain  from  equation 
(3.41) 

Xkvkyi  =  A(a)ukyl, 

and  we  obtain  the  claim.  ■ 

The  study  of  the  formations  that  can  be  achieved  with  control  law  (3.32)  can  be  addressed 
now. 


Theorem  3.3.2  Assume  that  -kd  is  not  an  eigenvalue  of  A(a).  Then,  agents’  positions 
starting  at  any  initial  condition  (except  for  a  set  of  measure  zero)  in  K3n  and  evolving  under 
(3.33)  exponentially  converge: 
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1.  if  kc  —  0,  to  formations  centered  at  the  initial  center  of  mass,  in  particular: 

(a)  if  0  <  |  a  |  <  7r /n,  to  a  single  limit  point; 

(b)  if  |  a  |  =  n/n,  to  an  evenly  spaced  circle  formation; 

(c)  ifn/n  <  | a |  <  2n/n,  to  an  evenly  spaced  logarithmic  spiral  formation; 

2.  if  kc  >  0,  to  formations  centered  at  the  origin,  in  particular: 

(a)  if  0  <  |a|  <  7 xjn,  to  a  single  limit  point; 

(b)  ifix/n  <  |ct|  <  27r/n 

i.  if  kc  >  2sin(7r /n)  sin(a  —  n/n),  to  a  single  limit  point; 

ii.  if  kc  =  2sin(7r/n)  sin(a  —  n/n),  to  an  evenly  spaced  circle  formation; 

Hi.  if  kc  <  2sin(7r/n)  sin(a;  —  7r/n);  to  an  evenly  spaced  logarithmic  spiral  forma¬ 

tion. 

Proof:  As  a  consequence  of  Theorem  3.3.1,  the  eigenvectors  of  C(a )  are  linearly  inde¬ 
pendent.  Indeed,  the  eigenvectors  14  for  k  G  {1, . . . ,  3n}  are  linearly  independent  since  the 
vectors  /q:  are  (see  Theorem  3.2.1);  moreover,  the  eigenvectors  Vk  for  k  G  {3n  +  1, . . . ,  6n} 
are  clearly  linearly  independent.  Since,  by  assumption,  —  kd  f  eig(A(a)),  the  independence 
of  the  eigenvectors  of  C(a )  follows. 

Then,  the  proof  is  a  simple  consequence  of  Theorem  3.2.1,  Corollary  3.2.2,  Theorem  3.3.1, 
and  the  arguments  in  Section  3.5  of  [67]. 


3.3.2  Control  law  with  relative  information  only 

Consider  the  following  feedback  control  law: 

Ui  =  fcii?2(o:)^(xi+2  -  xi+i)  -  (xi+i  -  Xi))  +  k2R(a)(±i+1  -  x,),  (3.42) 


73 


where  k\  and  k2  are  two  real  constants  (not  necessarily  positive).  In  this  case,  each  agent 
only  needs  to  measure  its  relative  position  with  respect  to  the  positions  of  agents  i  +  1  and 
i  +  2  (note  that  (xi+2  -  *i+i)  =  ((xi+2  -  x,)  -  (xm  -  x;))),  and  its  relative  velocity  with 
respect  to  the  velocity  of  agent  i  + 1.  Note  that  control  law  (3.42)  uses  a  rotation  matrix  that 
is  common  to  all  agents;  hence,  it  requires  that  all  agents  agree  upon  a  common  orientation, 
but  it  does  not  require  a  consensus  on  a  common  origin.  Indeed,  in  the  case  of  spacecraft, 
agreement  on  the  orientation  can  be  easily  achieved  by  using  star  trackers. 

It  is  possible  to  verify  that 

1-2  1  0  ...  0 

,  0  1-2  1  ...  0 
Li  = 

-2  1  0  .  1 

Then,  the  overall  dynamics  of  the  n  agents  can  be  written  in  compact  form  as 


(3.43) 


X 

1 - 

e 

o 

i _ 

X 

k\L\  <g>  R2(a)  -k2{Ll®R{a)) 

x  =  F(a)  x. 


(3.44) 


Let  A(a)  =  —L\  ®  R(a),  and  define 


(3.45) 


The  following  theorem  characterizes  eigenvalues  and  eigenvectors  of  F(a). 

Theorem  3.3.3  Assume  that  f3±  ^  O.The  eigenvalues  of  the  state  matrix  F (a)  in  equation 
(3.44)  are  the  union  of: 

•  the  3 n  eigenvalues  of  A{a),  each  one  multiplied  by  fi+, 

•  the  3 n  eigenvalues  of  A(a),  each  one  multiplied  by  /3_. 
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In  other  words,  eig(F(a))  =  j3+  eig(A(a))  U/?_  eig{A{a)).  Moreover,  the  eigenvector  of  F(a) 
corresponding  to  the  kth  eigenvalue  A  *  £  (3+eig(A(a)) ,  k  £  {1, . . .  ,3  n},  is: 

fce{l,...,3n},  (3.46) 

where  Hk  is  the  eigenvector  of  A(a)  corresponding  to  the  eigenvalue  A *,//?+.  Similarly,  the 
eigenvector  corresponding  to  the  kth  eigenvalue  A3 n+k  €  /3-eig(A(a )),  k  £  {1, . . .  ,  3n};  is: 


*4,1 

*4,2 

^kf^k 

^3n-\-k 


^3n+k,l 

Pk 

^3n+/c,2 

^kf-^k 

k  £  {1, . . . ,  3n}, 


(3.47) 


where  /r*,  is  the  eigenvector  of  A(a)  corresponding  to  the  eigenvalue  Xk/S-  ■ 


Proof:  First,  we  compute  the  eigenvalues  of  F(a).  Note  that,  by  the  properties  of  the 
Kronecker  product,  L 2  <g>  R2(a )  =  (L  ®  R(a))2  =  A2(a).  The  eigenvalues  of  F(a)  are,  by 
definition,  solutions  to  the  characteristic  equation: 


0  =  det 


/ 


VL 


Xpn  fin 

-k1A2(a)  \I3n  -  k2A(a) 


Using  the  result  in  equation  (2.1)  we  have  that 


(3.48) 


0  =  det  (A2/3n  —  k2XA(a)  —  kiA2(a )) 

=  det ((A hn  -  f3+A(a))(\I3n  -  p_A(ot))}. 


(3.49) 


Then,  the  first  part  of  the  claim  is  proven. 

By  definition,  the  eigenvector  [vk,\  vk;f\r  corresponding  to  the  eigenvalue  A*,,  k  £  {1, . . . ,  6n}, 
satisfies  the  eigenvalue  equation: 


75 


(3.50) 


^ k 

*4,1 

0 

^3  n 

*4,1 

= 

*4,2 

kxA2{a) 

k2A(a) 

*4,2 

*4,2 

k\A2(at)vk,\  +  k2A{a)ukt2 


Thus,  we  obtain 


Ajfcl4,  1  —  *4,2) 


Xkuk}2  =  kxA2(a)vK1  +  k2A{a)vK2, 


and  therefore, 


=  kiA2(a)vkti  +  k2A(a)XkukA, 


which  can  be  rewritten  as 

(A khn  —  /3+A(a))(XkI3n  —  f3-A(at))vkti  =  0. 


(3.51) 


(3.52) 


(3.53) 


(3.54) 


Therefore,  if  Xk  6  (3+eigA(a)  (analogous  arguments  hold  if  Xk  €  /3_eigA(a)),  the  above 
equation  is  satisfied  by  letting  vk,\  be  equal  to  fik,  in  fact  in  this  case  (notice  that  nk  is  the 
eigenvector  of  A(a)  corresponding  to  the  eigenvalue  A k/P+  and  that  (3+  ^0): 

Afc*4,i  =  =  f3+A(a)nk  =  p+A(a)vk,i,  (3.55) 

P+ 


and  the  claim  easily  follows.  ■ 

By  appropriately  choosing  kx,  k2  and  a,  it  is  possible  to  obtain  a  variety  of  formations. 
Here  we  focus  only  on  circular  formations  and  Archimedes’  spiral  formations  (an  Archimedes’ 
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spiral  is  a  spiral  with  the  property  that  successive  turnings  have  a  constant  separation  dis¬ 
tance),  which  are  arguably  among  the  most  important  symmetric  formations  for  applications. 
In  particular,  Archimedes’  spiral  formations  are  useful  for  the  solution  of  the  coverage  path¬ 
planning  problem,  where  the  objective  is  to  ensure  that  at  least  one  agent  eventually  moves 
to  within  a  given  distance  from  any  point  in  the  target  environment.  More  applications  will 
be  discussed  in  Section  3.5.  Circular  formations  are  initially  considered. 


3.3.2. 1  Circular  formations  with  only  relative  information 


To  start,  consider  the  following  lemma. 

03nxl 


Lemma  3.3.4  The  vector  Wk  = 


lik 


,  where  03nxi  is  the  zero  matrix  with  3 n  rows 


and  1  column,  is  a  generalized  eigenvector  for  the  zero  eigenvalues  X k,  where  k  =  n,2n,3n. 


Proof:  The  claim  can  be  easily  obtained  by  direct  verification  into  the  equation  (F(a)  — 
Xk  IsnflUk  Uk-  ® 

Theorem  3.3.5  Let  k2  =  2cos(7r/2 n)  and  k{  =  —  (k2/2)2  —  sin2(7r/2n).  Moreover,  assume 
that  a  =  7r/2 n;  then,  the  system  converges  to  an  evenly  spaced  circular  formation  whose 
geometric  center  has  constant  velocity. 


Proof:  With  the  above  choices  for  k\  and  k2,  it  is  straightforward  to  verify  that 

/ 3±  =  e?~T2n'> .  From  Theorem  3.3.3,  F(a)  has  exactly  two  eigenvalues  on  the  imaginary  axis, 
a  zero  eigenvalue  with  algebraic  multiplicity  6  and  geometric  multiplicity  3,  and  all  other 
eigenvalues  (3±Xk  in  the  open  left-half  complex  plane  with  linearly  independent  eigenvectors. 
Then,  by  using  Theorem  3.3.3  and  Lemma  3.3.4,  it  is  possible  to  show  that,  as  t  — >  +00,  the 
time  evolution  of  the  system  satisfies 


x(t) 

XG 

XG 

+  Cl 

1 

+  c2 

wL„ 

±(t) 

XG 

03nxl 

-UWdom 

WWLm 

(3.56) 
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where  xG  and  xG  are  the  initial  position  and  velocity  of  the  center  of  the  formation,  C\  and  C2 
are  constants  that  depend  on  the  initial  conditions,  a;  is  a  constant  equal  to  2  sin  (^) .  and, 
finally,  the  eigenfunctions  wdom,  p  E  {1,2},  are  given  by: 

wdom  =  [cos(ut+8i),sm(ut+5i),0, . . . ,  cos(cut+5n),  sin(u>t+Sn),  0], 

wdom  =  [sin(cut+5i), -cos(o?t-H5i),0, . . .  ,sm(ut+5n),  -  cos(ut+5n),0],  (3.57) 

where  St  =  2n(i  -  1  )/n,  i  E  {1, . . . ,  n}.  (Note  that  w*orT=  -u w2dom,  w2dor  =  uwjm.)  ■ 

Next  we  show  how  to  choose  k\,  k>2  and  a  to  achieve  Archimedes’  spiral  formations;  note 
that  an  Archimedes’  spiral  is  described  in  polar  coordinates  by  the  equation  g(p)  =  cup,  with 
a  E  E>o- 

3. 3. 2. 2  Archimedes’  spiral  formations  with  only  relative  information 

Consider  first  the  following  lemma. 

Lemma  3.3.6  Let  k\  =  —  (^2 /2)2  and  assume  a  =  7 r/n.  Then,  Wk  = 

generalized  eigenvector  for  the  eigenvalue  A k//3. 

Proof:  The  claim  can  be  easily  obtained  by  direct  verification  into  the  equation  ( F(a )  — 
Afc/gn)^fc  L'k  ■  ® 

Theorem  3.3.7  Let  k\  =  —  {k^fT)2,  and  assume  k2  >  0  and  o  =  7r jn.  Then,  the  system 
converges  to  an  Archimedes  ’  spiral  formation  whose  geometric  center  has  constant  velocity. 

Proof:  In  this  case  we  have  (3+  =  /?_  E  IR>o,  and  thus  A k  =  Afc+3n  for  all  A;  E  {1, . . . ,  3n}; 
as  a  consequence,  the  eigenvalues  of  F(a)  are  [3  eig(A(a)).  Hence,  F(a)  has  exactly  two 
eigenvalues  on  the  imaginary  axis,  each  one  with  algebraic  multiplicity  2  and  geometric 
multiplicity  1,  a  zero  eigenvalue  with  algebraic  multiplicity  6  and  geometric  multiplicity  3, 
and  all  other  eigenvalues  [3±Xk  in  the  open  left-half  complex  plane.  Then,  by  using  Theorem 


O371XI 

l^k 


is  a 
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3.3.3  and  Lemma  3.3.6,  it  is  possible  to  show  that,  as  t  — »  +oo,  the  time  evolution  of  the 
system  satisfies 


x(t) 

XG 

XG 

+di 

03nxl 

+  ^2 

03nxl 

±(t) 

XG 

03nxl 

WLn 

WLn 

+  [c\-\-d\t) 

Wdom 

+  (C2  +  <7^) 

WLn 

U^dom 

(3.58) 


where  xG  and  xG  are  the  initial  position  and  velocity  of  the  center  of  the  formation,  ci, 
C2,  d\  and  d%  are  constants  that  depend  on  the  initial  conditions,  ui  is  a  constant  equal  to 
2sin(^),  and,  finally,  the  eigenfunctions  w^om,  p  e  {1,2},  are  defined  in  equation  (3.57). 
Then,  agents  will  perform  spiraling  trajectories;  the  radial  growth  rate  is  a  constant  equal 
to  y/d\  +  d2,  and  the  center  of  the  formation  moves  with  constant  velocity  defined  by  the 
initial  conditions.  ■ 


3.4  General  Trajectories:  Conformal  Mapping 

In  this  section,  the  extension  to  achieving  more  general  and  useful  behaviors  is  presented 
based  on  the  idea  of  similarity  transformation  of  the  control  space.  In  this  approach,  invert¬ 
ible  transformations  are  applied  to  the  controller  to  achieve  more  general  trajectories  while 
maintaining  the  desirable  properties  of  global  convergence  and  synchronization  of  the  cyclic 
pursuit  algorithms. 

The  approach  is  described  for  the  case  of  the  basic  cyclic  pursuit  controllers  in  single 
integrators  which  can  be  extended  to  second  order  following  the  results  in  the  previous 
sections. 

Proposition  3.4.1  Consider  the  system  x  =  /(x),  x  €  M.N  that  converges  to  the  invariant 
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set  Mx  C  M.N . 


And  consider  an  arbitrary  differentiable  homeomorphic  mapping  x'  =  h(x),  h  :  lw  — > 

RN. 

Then,  a  control  strategy  for  which  the  dynamics  of  the  system  are  such  that  x'  =  Vxh /(/i_1(x/)) 
converges  to  an  invariant  set  in  A 4X>,  where:  x7  G  A4X >  =  h(5t),  x  G  AAX. 


Proof:  Consider  the  variable  x  =  h  ^x').  Its  dynamics  are  given  by 

X  =  ^  ^x/))  =  Vx'h-1*!  =  V3;'/^_1V;^;/^/(/l“1(x,))  (3.59) 

dt 

Since  h  is  homeomorphic  then  x  =  h_1(x'),  h-1  :  —>  RN ,  x7  =  (Vxh)ic  and  locally 

V x'h^V xh  =  I.  Then  the  dynamics  of  x  are: 


x  =  /(x) 


(3.60) 


which  converge  to  M.x  =  h  1(Adx'),  then  x'  =  /i(x)  — »■  h( JAX).  ■ 

A  similarity  transformation  is  a  particular  case  of  the  above  approach.  Consider  for 
example  a  simple  case,  a  linear  invertible  transformation  x  =  (/„  <g>  T)x'  =  Tx,  where 
T  G  IR3*3  is  an  invertible  matrix.  Consider  the  system  in  3.4  with: 

x  =  — £x  —  kc-x  (3.61) 

which  was  shown  to  converge  to  a  circular  formation.  By  applying  the  above  proposition 
Vxh  =  T  the  control  law  becomes: 

Ui  =  TRT~1(xi +i  -  xf)  -  kcXi  (3.62) 
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the  dynamics  of  the  transformed  system  become: 


x  =  T(-jC  -  /cc)T’_1x  (3.63) 

which  is  of  course  a  similarity  transformation  of  the  system  in  eq.  3.4.  For  this  new  system 
the  eigenvalues  are  the  same  as  those  of  the  non-transformed  system,  but  the  eigenvectors 
are  y!  =  T  y. 


Of  course,  each  vehicle  could  have  different  invertible  mappings,  yi  =  'Vxhif(hk  1yk),  then 
x  =  diag [h^iyi)],  Vxh  =  diag[Vxhi]. 


Fig.  3-2  illustrate  an  example  where  for  a  set  of  4  single-integrator  agents  the  control 
function: 


ttj  —  hj  (x^))  k(S7 xhih^  (xj) 

where  the  functions  h  are: 


f  (0.1  +  cos(6>)A 


& 

=  hi(rA-0  = 

9 

z' 

V 

z 

) 

r' 

^(0.4  +  cos  (9))^ 

9' 

=  h2(r,9,z)  = 

9 

z' 

V  *  ) 

(3.64) 


(3.65) 


(3.66) 
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y 


=  h3(x,y,z )  = 


z 


1.5 

0.45 

0.45 

0.45 

3 

0.45 

0 

0.45 

1.5 

and 


X 

X 

y 

=  h3(x,y,z) 

=  h 

y 

z 

z 

where  r,0,z  are  cylindrical  coordinates  in  the  respective  coordinate  set. 


(3.67) 


(3.68) 


This  section  presented  an  approach  that  substantially  extends  the  results  in  the  literature 
by  defining  transformations  of  the  basic  cyclic  pursuit  control  laws  such  that  the  formation 
converges  to  more  general  types  of  trajectories  and  can  be  useful  in  many  contexts.  In  the 
next  section  we  describe  a  situation  where  this  similarity  transformation  approach  is  used 
to  converge  to  natural  trajectories  of  a  system  with  more  specific  dynamics. 


3.5  Applications  of  Cyclic-Pursuit  Algorithms 


In  the  past  few  years,  cyclic  pursuit  has  received  considerable  attention  in  the  control  commu¬ 
nity  (see  Section  3.1);  however  to  date,  to  the  best  of  the  authors’  knowledge,  no  application 
has  been  proposed  for  which  cyclic  pursuit  is  a  particularly  effective  control  strategy.  In  this 
section,  we  discuss  application  domains  in  which  cyclic  pursuit  is  indeed  an  ideal  candidate 
control  law. 
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Figure  3-2:  A  formation  achieves  a  formation  with  some  arbitrary  trajectories  by  selecting 
specific  linear  and  nonlinear  transformations 

3.5.1  Interferometric  imaging  in  deep  space 


Interferometric  imaging,  i.e. ,  image  reconstruction  from  interferometric  patterns,  is  an  ap¬ 
plication  of  formation  flight  that  has  been  devised  and  studied  for  space  missions  such  as 
NASA’s  Terrestrial  Planet  Finder  -  Interferometer  (TPF-I)  and  Stellar  Imager  (SI)  and 
ESA’s  Darwin. 

The  general  problem  of  interferometric  imaging  consists  of  performing  measurements  in 
a  way  that  enough  information  about  the  frequency  content  of  the  image  is  obtained.  Such 
coverage  problem  is  independent  of  the  global  positions  of  the  spacecraft  [16];  additionally, 
missions  like  TPF-i  and  Darwin  consider  locations  far  out  of  the  reach  of  GPS  signals  and  are 
expected  to  only  rely  on  relative  measurements  to  perform  reconfigurations  and  observation 
maneuvers. 

The  general  problem  of  interferometric  imaging  consists  of  performing  measurements  in 
a  region  of  the  observation  plane  in  such  a  way  that  enough  information  about  the  spatial 
frequency  content  of  the  image  is  obtained.  A  heuristic  solution  to  this  coverage  problem  has 
been  proposed  to  be  the  set  of  Archimedes’  spiral  trajectories  [16],  where  the  baselines  for 
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Figure  3-3:  u-v  plane  coverage  by  a  system  of  multiple  spacecraft.  (Source  [16]) 


each  pair  of  sensors  describe  “coverage  discs”  as  shown  in  Fig. 3-3.  The  coverage  requirement 
is  a  nonlinear  function  that  conveys  the  fact  that  the  trajectories  of  the  “coverage  discs” 
should  allow  for  a  minimum  amount  of  time  to  be  spent  at  each  region  of  the  u-v  plane  to 
be  covered.  Such  coverage  constraint  can  be  written  as  [16]: 


i 

Y— - -  >  C  (3.69) 

Where  vT(p)  is  the  radial  component  of  the  velocity  as  a  function  of  the  intersatellite  distance, 
Nr  is  the  number  of  rings  formed  by  an  specific  configuration,  and  C  is  a  parameter  of  the 
image  that  defines  the  total  amount  of  light  collection  time  for  each  spatial  frequency,  b  has 
the  value  1  for  odd  total  number  of  vehicles  and  2  for  even  and  a,  is  a  geometric  parameter 
that  defines  the  ratio  between  the  radius  of  the  formation  and  the  distant  between  neighbors 
i  and  i  +  k. 


Figure  3-4  shows  simulated  trajectories  resulting  from  the  application  of  control  law 
(3.42);  the  initial  positions  are  random  inside  a  volume  of  (10 km)3.  In  the  first  case  spacecraft 
converge  to  circular  trajectories,  while  in  the  second  case  spacecraft  converge  to  Archimedes’ 
spirals.  The  inertial  frame  for  the  plots  is  the  geometric  center  of  the  configuration. 
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a) 


b) 


Figure  3-4:  Convergence  from  random  initial  conditions  to  symmetric  formations.  Left 
Figure:  Circular  trajectories.  Right  Figure:  Archimedes’  spiral  trajectories. 

3.5.2  On  reaching  natural  trajectories 

In  this  section  we  modify  the  previous  control  laws  to  achieve  convergence  to  elliptical  trajec¬ 
tories.  Consider  the  application  of  a  similarity  transformation  to  the  rotation  matrix  /?(<*), 
as  shown  in  Section  3.4 

It  is  straightforward  to  see  that  the  trajectories  arising  with  the  previous  control  laws 
are  then  transformed  according  to 

Xj(t)  =  Txi{t),  *€{l,...,n};  (3.70) 

in  particular,  circular  trajectories  can  be  transformed  into  elliptical  trajectories. 

Indeed,  the  above  approach  is  useful  to  allow  the  system  to  globally  converge  to  low-effort 
trajectories.  Consider  the  dynamic  system 

X,  =  /(Xi,Xi)+Ui 

=  /(x„x.)  -  (/(Xi,Xi)  -  unomJ,  (3.71) 

which  has  a  zero-effort  (tij=0)  invariant  set  x*,  for  which  f(x*,x*)  =  unorni.  If  we  use  a 
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controller  for  which  the  state  reaches  x*(t)  as  t  — >  oo,  then  the  control  effort  will  tend  to 
Uj  =  0  as  t  — >  oo. 

In  the  case  of  the  dynamics  of  relative  orbits  slightly  perturbed  from  a  circular  orbit, 
elliptical  relative  trajectories  are  closed  near-natural  trajectories  (i.e.  theoretically  they 
require  no  control  effort);  in  the  following  section,  cyclic-pursuit  controllers  are  proposed  as 
promising  algorithms  for  formation  acquisition,  maintenance  and  reconfiguration. 


3.5.2. 1  Clohessy-Wiltshire  model 

The  Clohessy-Wiltshire  model  approximates  the  motion  of  a  spacecraft  with  respect  to  a 
frame  that  follows  a  circular  orbit  with  angular  velocity  uR  and  radius  Rrej  =  (/%/u4)1/3, 
where  p®  is  the  gravitational  constant  of  Earth.  The  equations  of  motion  x*  =  /(x*,  Uj)  are: 

=  2cu Ryi  T  3 u)RXi  T  it  ix . 

Vi  =  -2  uRXi  +  uiy,  (3.72) 

Zi  —  —utftZi  T 

where  the  x,  y  and  z  coordinates  are  expressed  in  a  right-handed  orthogonal  reference  frame 
such  that  the  x-axis  is  aligned  with  the  radial  vector  of  the  reference  orbit,  the  z-axis  is 
aligned  with  the  angular  momentum  vector  of  the  reference  orbit,  and  the  y-axis  completes 
the  right-handed  orthogonal  frame. 

Consider  a  formation  of  spacecraft  that  use  the  cyclic-pursuit  controller 
Ui  =  -/(xi)  +  kg{kdTR{a)T~1{y:i+ 1  -  x,)  +  TR(a)T~1(xi+ 1  -  x4) 

(3.73) 

kck(iX-i  (kc  T  kd/kg)ii.i), 
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with  kg  =  Wft/(2sin(7r/rc)),  and 


T  = 


5  0  0 

0  10, 

•zb  cos(0z)  z0  sin  (</>2 )  1 


(3.74) 


where  z0  and  (pz  are  tunable  parameters  (their  roles  will  become  clear  later).  Then,  from  the 
results  in  Section  3.3,  we  obtain,  as  t  — >  oo, 


Xi(t)  =  x*  (t)  =  T 


rsm(ujRt  +  Si) 
r  cos (u>Rt  +  Si) 
0 


i  e  {1, . . .  ,n}, 


(3.75) 


where  Si  =  2ir(i  —  1  )/n,  and  r  is  a  constant  that  depends  on  the  initial  conditions.  Thus,  we 
obtain 


x*(t)  =  r  sin(u Rt  +  Si ), 

y*(t)  =  rcos(uRt  +  Si),  (3.76) 

z* (t)  =  zQr  sin (ujRt  +  Si  +  <f>z); 

hence,  the  formation  will  converge  to  an  evenly-spaced  elliptical  formation  with  an  x  :  y 
ratio  equal  to  1  :  2,  a  y  :  z  ratio  equal  to  1  :  z0,  and  a  phasing  between  the  x  and  2  motion 
equal  to  4>z.  By  replacing  these  equations  into  equation  (3.72),  it  is  easily  shown  that  as 
x(t)  —>  x*(t),  we  have  u  — >  0. 

3.5.3  Including  Earth’s  oblateness  effect 

A  more  accurate  model  for  the  motion  of  a  spacecraft  formation  considers  the  effects  of  the 
oblateness  of  the  Earth,  specifically  the  higher  order  spherical  harmonics  of  the  gravitational 
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force  model,  denoted  as  Jk •  In  [86],  Schweighart  and  Sedwick  show  that  the  equations  of 
motion  relative  to  a  circular  non-Keplerian  reference  orbit  and  including  the  J2  term  are  well 
approximated  by  the  linear  system: 


3 

2 uRcjji  +  (5c2  -  2 )u%Xi  +  uxi  +  -KJ2  cos(2 kt), 

(3.77) 

-2c oRc±i  +  uyi  +  -IO2  sin(2 kt), 

(3.78) 

-q2Zi  +  2lqcos(qt  +  <&)  +  uzi, 

(3.79) 

where,  again,  the  x,  y  and  2  coordinates  are  expressed  in  a  right-handed  orthogonal  reference 
frame  such  that  the  x-axis  is  aligned  with  the  radial  vector  of  the  reference  orbit,  the  2-axis 
is  aligned  with  the  angular  momentum  vector  of  the  reference  orbit,  and  the  y-axis  completes 
the  right-handed  orthogonal  frame;  moreover,  c  =  \/l  +  s,  s  =  gffi1  (1  +  3  cos (2 iref)),  Kj 2  = 
sin2(ire/),  Rc  is  the  nominal  radius  of  the  earth,  k  =  c  +  cos2  iref,  rref  and  irej 
are  parameters  of  the  reference  orbit,  q  is  approximately  equal  to  cu>R,  and  <f>,  l  are  time 
varying  functions  of  the  difference  in  orbit  inclination  (see  ref.  [86]  for  the  details).  Zero- 
effort  trajectories  (i.e,  trajectories  with  u,  =  0)  for  the  above  dynamic  model  are  shown  to 
be: 


x*(t) 

V*(t) 

z*(t) 


__  g 

x0  cos(cjRtVl  -  s)  +  ■  ^ - y{)  sm((jRt\/l  -  s)  +  xcc(t), 

L\J  1  +  s 


x0  2  sin^flt-v/l  -  s)  +  y0  cos(uRty/l  -  s)  +  ycc(t), 
\/l  ~  s 

(It  +  m)  sin(qt  +  <l>), 


(3.80) 


with 


Xcc(t)  =  [a(cos(2kt)-cos(ujRt^l  —  s)),  f3sin(2kt) - -  a(cos(cjRt\/l  —  s)),  0]T,  (3.81) 

y  J.  S 
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where  a,  (3,  and  m  are  constants  that  depend  on  the  reference  orbit  parameters  and  for 
brevity  are  not  discussed  here.  (For  details  we  refer  the  reader  to  the  work  of  Schweighart 
and  Sedwick  [86].)  As  in  the  previous  section,  by  defining  the  control  coordinates  in  a 
reference  frame  centered  in  xcc(f),  and  using  the  decentralized  cyclic- pursuit  controller  in 
equation  (3.73)  with  a  transformation  matrix 


T 


y/l  —  S 

2-yi+s 

0 

Z0  COS ((f) z) 


0  0 

1  0  , 

Zo  sin (<f>z)  1 


(3.82) 


and  kg  =  ojr\/1  —  ,s/(2  sin(7r/n)),  it  is  straightforward  to  show  that  the  formation  will 

converge  to  elliptical  trajectories  centered  at  the  point  xcc(t).  Then,  as  t  — >  oo,  x(<)  — » 
r  sin  (u)Rt  +  Si) 

I 

+  Xgc,  and  thus,  as  t  — >  oo,  the  trajectories  for  x(t),  y(t )  are  those 


T 


rcos(uRt  +  Si) 


0 


L—  —I 

described  in  equation  (3.80),  and  we  have  that: 


ux  — t  0, 

uy  0,  (3.83) 

uz  — >  {u2r  —  q2)  +  2lqcos(qt  +  $)  «  2lqcos(qt  +  $). 

The  last  term  corresponds  to  the  cohesive  force  required  to  maintain  the  formation  when 
the  orbits  are  not  coplanar  (i.e.  the  spacecraft  have  different  inclination  and  thus  different 
J2  secular  drift  rates).  For  — y  0,  then  q  =  lor,  l  —>  0  and  the  theoretical  required  thrust 
converges  to  zero. 

Figure  3-5  shows  simulation  results  for  the  control  laws  described  in  this  section.  The 
system  is  simulated  using  dynamics  including  the  J2  terms.  The  results  show  convergence 
from  random  initial  positions  to  the  desired  orbits,  i.e.,  an  evenly-spaced  elliptical  formation 
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b)  Motion  w.r.t  to  ref  point  in  circular  trajectory 


Figure  3-5:  Convergence  to  elliptical  trajectories  with  dynamics  including  J2  terms. 


in  the  desired  plane.  It  is  also  shown  (Fig.  3-5b)  how  the  control  effort  reduces  as  the 
spacecraft  reach  the  desired  low-effort  trajectories.  In  this  case  the  orbits  are  coplanar  and 
the  differential  J2  effects  in  the  2  direction  converge  to  0.  The  dots  indicate  the  positions 
after  3  orbits.  3-5a)  is  a  3D  view  of  the  trajectories  with  respect  to  reference  point  xcc.  Fig. 
3-5b)  is  a  3D  view  of  the  trajectories  with  respect  to  non-keplerian  circular  orbit.  3-5c)  is  a 
plot  of  the  control  effort  versus  time,  showing  that  as  t  -4  00,  u  — >  0. 

Although  the  achieved  trajectories  are  not  natural  trajectories  for  a  free  orbiting  body, 
the  proposed  decentralized  control  law  allows  convergence  to  elliptical  formations  that  are 
near-natural  and  would  require  low  fuel  consumption  for  their  maintenance. 


3.6  Summary  and  Conclusions  of  the  Chapter 

Linear  cyclic  pursuit  dynamics  were  analyzed  using  an  eigendecomposition  approach.  The 
special  structure  of  the  underlying  structure,  specifically  block  rotational-circulant  matrices 
allows  for  the  derivation  of  analytical  expressions  of  the  decomposition.  This  analytical 
description  of  the  dynamics  allowed  for  developing  controllers  suited  for  spacecraft  control 
problems  of  interest. 
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The  main  contributions  of  this  chapter  are  threefold.  First,  building  upon  previous 
work  on  cyclic-pursuit  algorithms,  we  rigorously  study  cyclic,  distributed  control  laws  for 
formation  flying,  for  both  single-integrator  and  double-integrator  models  in  three  dimensions. 
Second,  we  described  a  method  to  achieve  decentralized  controllers  based  on  the  cyclic 
pursuit  structure  that  achieve  convergence  to  linear  and  nonlinear  transformations  of  circular 
trajectories. 

And  lastly,  we  discuss  potential  applications  and  describe  the  application  of  the  control 
approach  including  spacecraft  formation  for  interferometric  imaging  and  LEO  formation 
acquisition  and  maintenance.  The  control  laws  are  based  on  those  theoretical  results  and 
are  shown  to  be  fit  to  deal  with  the  (linearized)  relative  dynamics  of  spacecraft,  e.g.,  in 
the  Earth’s  gravitational  field.  A  key  feature  of  the  control  approach  is  that,  unlike  other 
approaches,  they  do  not  require  any  agreement  on  a  set  of  predetermined  trajectories. 
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Chapter  4 


Contraction  Theory  Approach  to 
Formation  Control 


In  this  chapter,  an  alternative  direction  in  the  analysis  of  control  laws  inspired  as  a  gen¬ 
eralization  of  the  cyclic  pursuit  control  laws  from  Chapter  3  is  presented.  This  alternative 
approach  is  introduced  as  a  tool  to  embrace  more  general  dynamical  systems,  placing  the 
previous  results  in  the  more  general  context  of  convergence  to  manifolds.  Understanding 
the  problem  as  such  could  be  more  intuitive,  opens  an  alternative  road  to  verifying  global 
convergence  for  more  complex  distributed  controllers  and  can  be  applied  in  the  case  of  non- 
autonomous  and  nonlinear  dynamics. 

The  proposed  approach  is  based  in  the  theory  of  partial  contraction,  shortly  mentioned  in 
Section  2.1.  It  yields  global  convergence  results  and  direct  extensions  for  nonlinear  systems 
and  more  general  dynamic  cases.  It  also  allows  the  introduction  of  convergence  primitives, 
where  control  laws  consist  of  combinations  of  simpler  control  laws,  converge  to  a  subspace 
defined  where  the  constraints  in  the  desired  configuration  are  convergence  subspaces  of  the 
primitives  and  the  combination  of  them  achieves  more  complex  formations..  Particularly,  the 
contraction  theory  results  lead  to  identifying  sufficient  conditions  for  the  convergence  to  a 
given  manifold.  Then,  distributed  control  laws  that  satisfy  these  conditions  can  be  proposed 
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and  their  convergence  properties  verified. 

Contraction  theory  proves  itself  as  a  valuable  method  to  analyze  the  convergence  of 
distributed  systems  for  which  methods  like  Lyapunov  functions  might  not  be  suitable.  In  the 
contraction  theory  approach,  the  general  idea  consists  of  showing  the  negative  definiteness 
of  a  projected  Jacobian  matrix  which  characterizes  the  dynamics  of  an  agreement  subspace. 
Showing  the  negative  definiteness  of  a  matrix  in  the  case  of  a  distributed  system  can  turn 
more  attainable  than  demonstrating  the  negativeness  of  a  Lyapunov  rate  which  is  a  function 
of  multiple  states  that  depend  on  each  other. 

In  a  first  result,  applying  the  contraction  approach  to  a  generalized  version  of  the  cyclic 
pursuit  approach  leads  to  a  generalization  to  time  varying  and  state  dependent  cyclic  con¬ 
trollers.  Convergence  results  extend  in  a  straightforward  way  to  achieving  polygons,  circular 
and  spiral  rotating  formations,  addressing  time  varying  and  state  dependent  gains  and  cou¬ 
pling  matrices.  Then,  a  series  of  results  and  corollaries  of  extending  the  contraction  theory 
approach  to  time  varying  subspaces  and  linear  combinations  of  basic  primitives  are  derived. 
Specifically,  a  result  on  the  linear  combination  of  basic  control  functions  shown  to  converge 
to  basic  manifolds  M. ;,  which  are  dubbed  ’primitives’.  Several  applications  of  applying  these 
results  are  shown  to  illustrate  the  proposed  idea. 

Since  our  main  objective  is  the  introduction  of  the  dynamic  analysis  approach,  we  focus 
on  examples  using  simple  integrator  dynamics  but  illustrate  in  a  later  section  the  proposed 
approach  to  implementing  the  control  algorithms  in  more  general  contexts. 

The  distribution  of  this  chapter  is  as  follows:  Section  4.1  introduces  the  approach  to 
convergence  analysis  based  on  contraction  theory,  it  is  extended  by  studying  a  comparison 
to  the  approaches  in  the  previous  literature  and  specifically  describing  the  contraction  theory 
approach  to  the  control  laws  as  related  to  an  example  previously  presented  in  the  literature. 
Then,  Section  4.2  derives  control  laws  for  global  convergence  to  regular  polygonal  formations 
and  presents  a  result  for  global  convergence  to  a  regular  formation  of  specific  size.  Section  4.3 
describes  the  convergence  results  of  the  approach  based  on  control  primitives  which  are 
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illustrated  through  applications  in  a  later  Section  4.4.  Brief  concluding  remarks  are  presented 
in  Section  4.5. 


4.1  Introduction 

In  this  section  we  introduce  the  basic  idea  of  contraction  theory,  and  describe  the  relationship 
to  an  example  in  a  recent  work  by  Pham  and  Slotine  [68].  Then,  we  extend  the  results  by 
addressing  the  case  of  convergence  to  time  varying  manifolds. 

Consider  the  system  with  closed  loop  dynamics: 


x  =  f(x,t)  (4.1) 

where  x  €  R",  and  consider  a  flow  invariant  manifold  of  f  (x,  t),  defined  as  the  subset  A4  C  Mn 
such  that  f  (x)  €  A4  for  all  x  G  A4 . 

Consider  a  smooth,  continuous  transformation  V(x)  :  Kn  — >  Rp,  such  that  the  invariant 
manifold  M  can  be  described  as  the  null  space  of  V(x),  i.e.  M.  :  {x  |  V(x)  =  0}. 

The  dynamics  of  the  perpendicular  projection  y  =  Vx  can  be  written  as: 

y  =  Vxf(x,t) 

=  Vxf(y,x,t)  (4.2) 

The  general  idea  of  the  partial  contraction  theory  consists  of  showing  the  contractive  behavior 
of  the  above  system.  If  this  perpendicular  system  is  shown  to  be  contracting,  all  trajectories 
of  this  system  will  converge  to  the  same  one,  y  =  0  is  a  specific  trajectory  of  the  system, 
therefore  all  trajectories  of  4.1  will  converge  to  trajectories  in  y  =  V(x)  =  0. 

As  mentioned  in  the  introduction  to  the  contraction  theory  in  Section  2.1,  the  system  4.1 
is  said  to  be  contracting  if  there  exists  a  square  invertible  transformation  0(x,  t)  such  that 
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0(x,  t)T0(x,  t)  is  uniformly  positive  definite  and  the  matrix: 


F  = 


(4.3) 


is  uniformly  negative  definite,  where  ||  is  the  Jacobian  matrix  of  f  with  respect  to  x. 

0  can  be  an  identity  transformation,  and  in  many  cases  it  is  a  sufficient  definition  to 
show  convergence.  In  other  cases,  as  will  be  shown  in  an  example,  the  problem  consists  of 
finding  a  transformation  0. 

Now,  consider  a  linear  case  where  F(x)  is  a  linear  transformation,  V  e  WjXn. 

Consider  an  orthogonal  partition  of  the  state  space  VVT  =  Ip  and  VTV  +  UTU  =  /„ 
such  that  V  =  TV.  Then,  the  Jacobian  of  the  perpendicular  projection,  also  referred  in  this 
thesis  as  the  projected  Jacobian  is: 


J I, 


d(V  f(x,  t)) 
dy 


v(df(VTy  +  UTUx,t) 


dy 


=  V 


df(x) 

dx 


V 


T 


(4.4) 

(4.5) 

(4.6) 


If  V  is  row  independent,  T  is  an  invertible  transformation.  It  is  clear  that  for  an  invertible 
T,  V^VT  =  TV^VTTT  <  0  ^  V^VT  <  0.  Therefore,  we  can  define  a  sufficient 
condition  for  global  convergence  to  the  manifold  V (x)  =  0  to  be: 


rT<o 


(4.7) 


4. 1.0.1  Example 

As  an  introductory  example  of  the  application  of  the  approach,  we  present  results  for  a 
three-vehicle  cyclic  pursuit  control  algorithm  as  related  to  an  example  presented  by  Pham 
and  Slotine  [68]. 
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In  their  example,  Pham  and  Slotine  consider  the  set  of  Androno-Hopf  oscillators  related 


to  locomotive  behavior  of  salamanders: 


±i  =  f(Xi)+Ui 


X 

=  ki 

x  —  y  —  x3 

-xy2 

f 

y 

x  +  y-y3 

-  yx2 

while  adding  a  cyclic  coupling: 


(4.8) 

(4.9) 


Xr  =  f(Xi)  +  k(R2n/3^2  -  Xi) 

(4.10) 

x2  =  f(xx)  +  k(R2i r/3X3  -  X2) 

(4.11) 

x3  =  f(xx)  +  k(R27T/ 3Xx  -  x3) 

(4.12) 

where  R(a)  is  a  rotation  matrix  for  an  angle  a,  and  the  overall  system  can  then  defined  as: 


x  =  f  (x)  —  A;Lx 

The  manifold  Ma,  which  defines  circular  formations  about  the  origin: 


(4.13) 


Ma  =  {i?(27r/3)(x),  R{  7t/3)(x),  x}  (4.14) 

can  be  shown  to  be  an  invariant  manifold  of  f(x)  and  also  an  invariant  manifold  of  Ls  = 
L  +  Lt. 


For  k  >  2/3,  the  eigenvalues  of  the  projected  Laplacian  VLVT  are  guaranteed  to  be 
less  than  the  eigenvalues  of  the  projected  Jacobian  of  f,  V  ^T>  and  thus  the  negative 

definiteness  of  the  projected  Jacobian  of  f(x)  —  kh  is  verified.  If  f(x)  =  0,  the  convergence 
to  AIa  is  also  verified. 
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Now  if  instead  a  cyclic  pursuit  approach  is  applied,  such  that 

Xi  =  f(xi)  +  kRn/3(x2  -  Xi) 

x2  =  f(xi)  +  kRn/sfa  -  x2)  (4.15) 

x3  =  f(xa)  +  kR*x /3(x.\  -  x3) 

in  this  case  the  overall  dynamics  can  be  described  as: 

x  =  f(x)  —  £x  (4.16) 

where  £  =  L  0  R(n/3),  with  L  being  the  laplacian  of  the  ring  topology  described  in  eq. 
3.5.  Then,  when  considering  the  same  invariant  manifold,  Ma,  it  is  found  that  V jCVt  <  0, 
Vf  (x)HT  <  0  and  the  convergence  to  the  manifold  is  verified  for  this  dynamical  system  too. 
However,  in  the  case  when  f  =  0,  the  convergence  to  V  is  not  verified  because  the  projected 
Laplacian  is  only  positive  semidefinite. 

On  the  other  hand,  consider  looking  at  the  convergence  to  the  larger  subset: 

Mn  =  {x  :  (xj+i  -  =  i?2^(xi+2  -  Xf+i)},  Vi  <  n  —  1  (4.17) 

that  describes  states  where  the  vehicles  are  in  a  regular  polygon  formation  as  shown  in  figure 
4-1.  Notice  that  Ma  C  Mn.  Mn  can  be  shown  to  be  a  flow-invariant  manifold  for  the  cyclic 
pursuit  law: 

xi+i  -  Xi  =  R(a)(xi+2  ~  xi+x)  -  (xi+i  -  x*) 

n 

=  i?2Ii?(a)(xi+3  -  xi+2)  -  i?22ri?(a)(xJ+2  -  Xj+i) 

n  n 

=  i?22L(Xi+2)  —  J?22;(Xi+l) 

n  n 

Xi+l-Xi  =  R2z(Xi+2  -Xi+i)  (4-18) 
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R(2xln)(xlt2 -x1+1) 


"O. 


,o 


Figure  4-1:  Constraint  description  of  M5 


Then,  the  matrix  Vrn,  such  that  Vrnx  =  Mn  is: 


Vm  = 


- F  I  +  i?27T  — Ft  2tt 

n  n 

0  — I  I  Ft  2-n 


0  ...  0 

—  Rgn  0  .  .  . 


n  n 


(4.19) 


In  the  case  of  3  vehicles,  with  a  =  7r/3,  Vr  corresponds  to: 


Vr3 


-1  0  3/2  x/3/2  -1/2  —  x/3/2 

0  -1  -y/3/2  3/2  y/3/2  -1/2 


And  the  transformed  Jacobian  is: 


Vr3csvr 


r3 


— 6  -3^3 

3\/3  -6 


(4.20) 


(4.21) 


which  is  negative  definite,  with  A(Vrr3^sKs)  =  { — 6,  — 6},  which  verifies  the  global  conver¬ 
gence  to  manifold  Mn  if  eig( l/r3diag[- (-}+xf T  (x) ]  VrJ3 )  <  6.  In  Section  4.2,  a  generalized  result 
that  addresses  analytical  results  for  any  number  of  vehicles  and  under  combinations  of  dif¬ 
ferent  cyclic  topologies  is  shown. 
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4.1.1  Time  varying  and  nonlinear  manifolds 


After  having  introduced  the  general  concept,  the  case  of  a  more  complex  type  of  systems, 
namely  nonlinear  systems  with  possibly  time  varying  convergence  manifolds  are  introduced 
in  this  section.  The  framework  presented  by  Pham  and  Slotine  in  their  previous  work  [68] 
discusses  the  convergence  for  linear  time  invariant  manifolds.  It  is  possible  however,  to 
extend  their  results  to  a  more  general  version  considering  nonlinear,  time  varying  manifolds 
by  proceeding  in  a  similar  manner.  Such  results  are  shown  useful  in  the  developments  and 
applications  presented  in  the  later  sections. 

A  very  helpful  extension  of  the  contraction  theory  approach  consists  of  showing  the 
contracting  properties  of  an  auxiliary  system  that  has  solutions  of  the  actual  system  as 
particular  solutions.  Consider  a  nonlinear  system  that  can  be  written  in  the  form: 

x  =  F(x,  t)x  (4.22) 

with  an  invariant  manifold  x  6  M  :  {x  :  Vx  =  0},  such  that  VF(x)x  =  0. 

Consider  the  auxiliary  system: 

x  =  F(z,t)x  (4.23) 

which  has  specific  solutions  z (t)  =  x(t)  and  z  =  0. 

The  dynamics  of  the  perpendicular  projection  are  given  by: 

y  =  VF(  z,  t)  (PTy  +  UTUx)  (4.24) 

then,  the  projected  Jacobian  is: 

Jy  —  VF(z,t)VJ  (4.25) 
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Therefore,  the  auxiliary  system  is  contracting  if: 


(0  +  0(VF(z,,t)VT))Q  1  <  0  uniformly  (4-26) 

in  which  case  all  trajectories  converge  to  the  same  one,  and  x(t)  =  0  is  one  of  them.  Again, 
since  V  =  TV,  then: 

VF(x,  t)VT  <  0  uniformly  (4.27) 

is  a  sufficient  condition  for  convergence  to  M. . 

The  following  theorem,  extends  the  partial  contraction  theory  for  convergence  to  nonlin¬ 
ear  and  time  varying  manifolds: 

Theorem  4.1.1  Consider  a  nonlinear  system  that  can  be  written  in  the  form: 

x  =  F(x,  t)x  (4.28) 

with  a  (possibly  time  varying)  invariant  manifold  x  G  M(i)  :  {x  :  V"(t)x  =  0},  such  that 
(jj(V(t)x)  =  0.  Then,  the  system  converges  to  x  6  M.{t)  i/30; 

(0  +  0(!7Ft  +  7F(x,  t)^)©"1  <  0  uniformly  (4.29) 

or, 


(VVT  +  VF(x,t)VT)  <  0  uniformly 


(4.30) 


Proof: 

The  dynamics  of  the  perpendicular  projection  are  given  by: 

y  =  V(VTy  +  C7Tf7x)  +  VF{ z,  t)(VTy  +  UTUx )  (4.31) 
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then,  the  projected  Jacobian  is: 


Jy  =  ?VT  +  VF(z,t)Vr  (4.32) 

Therefore,  the  auxiliary  system  is  contracting  if: 

(0  +  Q(VV  +  VF(z,  fjV^))©-1  <  0  uniformly  (4.33) 

in  which  case  all  trajectories  converge  to  the  same  one,  and  x(t)  =  0  is  one  of  them.  Again, 
since  V  =  TV,  V  =  TV  then: 

VVT  +  7F(x,  t)VT  <  0  uniformly  (4-34) 

is  a  sufficient  condition  for  convergence  to  A4.  ■ 


4.2  Cyclic  Controllers  for  Convergence  to  Formation 

The  most  common  approach  to  formation  control  studied  in  the  literature  defines  laws  based 
on  tracking  relative  positions  to  a  set  of  neighbors.  This  approach  is  not  always  the  most 
desirable,  and  the  control  effort  can  often  be  significantly  reduced  by  eliminating  the  ’un¬ 
necessary’  constraints  in  the  formation  degrees  of  freedom.  Then  the  convergence  is  given 
as  converging  to  desired  manifolds  defined  by  linear  or  nonlinear  constraints.  Additionally, 
if  the  emergent  behavior  is  an  overall  formation  state  with  some  unconstrained  degrees  of 
freedom,  a  leader  or  a  pair  of  leaders  can  control  those  states  for  the  whole  formation  without 
the  need  of  a  global  coordination  mechanism  reassigning  relative  position  targets. 

Some  authors  have  studied  the  convergence  to  relevant  symmetric  formations  by  using 
potential  functions,  e.g.  [64,88].  A  main  pitfall  is  convergence  to  local  equilibria,  lead¬ 
ing  to  a  lack  of  global  convergence  guarantees  and  unpredictability  of  the  behavior  under 
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disturbances.  These  difficulties  exacerbate  in  the  time- varying  case.  Guaranteed  global  con¬ 
vergence  to  formation,  in  itself  a  highly  desirable  property,  also  has  important  implications 
in  the  robustness  of  the  formation  architecture. 

The  results  of  applying  the  above  described  contraction  theory  approach  to  the  problem 
are  presented  by  consider  the  generalization  of  the  cyclic  pursuit  to  time  varying,  state 
varying  control  functions.  This  also  leads  to  addressing  the  proof  of  global  convergence  for 
a  type  of  distributed  controllers  based  on  cyclic  topologies. 

4.2.1  Generalized  cyclic  approach  to  formation  control 

Based  on  the  presented  approach  and  the  time  varying  extension  on  the  previous  section,  we 
present  theoretical  results  for  the  convergence  to  symmetric  formations  based  on  control  laws 
that  generalize  the  cyclic  pursuit  algorithm  to  more  general  interconnections  and  nonlinear 
cases.  First  we  show  the  global  convergence  of  a  basic  control  law  to  regular  polygons  under 
a  generalized  nonlinear  cyclic  topology  with  any  number  of  vehicles  and  then  we  show  how 
this  result  directly  verifies  the  global  convergence  to  rotating  circular  formations  in  the  case 
of  the  basic  cyclic  pursuit  algorithm. 

These  control  law  generalizes  the  results  and  allow  the  design  of  distributed  algorithms 
that  converge  to  formations  with  geometric  characteristics  that  depend  on  a  common  coordi¬ 
nation  state,  and  can  be  time  varying.  One  can  think  for  example  a  satellite  formation  that 
expands,  contracts  (by  varying  a)  or  speeds  up  (by  varying  k)  as  a  function  of  its  location 
in  orbit. 

Consider  the  first  order  system  x  =  /(x)  +  u  and  the  generalized  symmetric  cyclic  control 
law: 


u i(x,i)  =  krn(*,t)  (Km(x,t)(x[i+m]  -  X;)  +  i2^(x,  i)(X[<_m]  -  Xj))  (4.35) 

m€  Mr 

where  jVr  is  a  set  of  relative  neighbors  in  the  ordered  set  {l,..,iV},  and  \p\  <E  N} 
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Figure  4-2:  Different  cyclic  topologies 


indicates  p  modulo  N.  The  expression  in  eq.  (4.35)  indicated  that  for  each  link  {i,  [i  +  m]} 
there  is  a  symmetric  link  {z,  [i  —  m]}.  fcm(x,  t)  £  M>o  is  a  gain  and  R(x,t)  is  a  coupling 
matrix  that  can  be  selected  to  achieve  different  behaviors.  A  general  description  of  the 
overall  dynamics  of  a  system  can  then  be  written  as: 

x  =  f(x)-^fcm(x,i)((Lm®i?m(x>i)  +  L^®i2^(x,i)))x 

m 

=  f(x)  -  2^fcm(x,t)(£fr.(x,t)  +  £^(x,t))x  (4.36) 

m 

and 


=  (Cm(x,t)  +  £^(x,t))  (4.37) 

where  x  is  the  vector  describing  the  overall  state  of  the  system  and  Lm  are  m-circulant 
Laplacian  matrices  describing  cyclic  underlying  topologies  with  interconnections  to  each  m- 
other  agent  as  show  in  fig.  4-2. 
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Now,  consider  the  manifold  A4n,  presented  in  section  4.1: 

Mn  =  {x  :  (xi+1  -  Xj)  =  R^.{xi+ 2  -  Xi+i)}  =  {x  :  Vrnx  =  0},  (4.38) 

which  can  be  shown  (straightforward  from  eq.  (4.18))  to  be  a  flow-invariant  manifold  of  the 
dynamic  system  x  =  k(x,  t)(Csm(x,  f))x. 

Note  that  Vrn  can  be  written  for  the  general  case  of  n  vehicles  in  3 D  as: 

Vr  n  =  {K®h){In®Rv){{L1®R^/N)  +  {Lj®Rl/N))  =  KnlZriC^  (4.39) 

with  K  =  [/n_3|03„_3],  Li  is  a  cyclic  Laplacian  for  a  1-circulant  topology  and  Rn  is  a  rotation 
matrix  for  any  value  r/. 

Since  Vrn  is  full  row  rank,  there  exists  an  invertible  transformation  Vrn  =  TVrn  such  that 
if  VrnA(Vrn)T  >  0  then  VrnAV^n  >  0,  where  the  columns  of  Vrn  are  a  set  of  orthonormal  basis 
such  that  Vrn(Vrn)T  =  I.  Then,  following  the  results  of  partial  contraction  theory  described 
in  sec  4.1,  we  have  that  if: 

^m(x,  t'j/Zgj 7j(x,  f) 

then,  the  system  converges  to  M.n- 

Since  1Zn,  C^N\  £sm(x,  t)  £  C7Z,  the  calculation  of  the  eigenvalues  of  their  product  and 
correspondingly  verifying  that  (£)m  km(x,  f)£S7n(x))(£(JV))T Kj  <  0  uni  formly 

is  straightforward  and  is  shown  in  appendix  A. 5.  The  results  are  applied  in  the  following 
theorem: 

Theorem  4.2.1  Distributed  nonlinear  approach  for  global  convergence  to  sym¬ 
metric  formations 

Consider  the  distributed  system  with  a  generalized  cyclic  topology,  using  control  law  in  eq. 


{CWyn^Kl  <  0  uniformly  (4.40) 


KnnvjC w 


df(x) 

dx 
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(4-35): 


Xj  =  f(x)-+Uj(x,i)  (4.41) 

u i(x,i)  =  ^  fcm(x,t)(J?rn(x,i)(x(i+m] -xi)  +  /2(-am(x,i))(x[i_m] -Xj))  (4.42) 

m£j\fr 

for  which  a  description  of  the  overall  dynamics  is  written  as: 


x  =  f(x)  -  ^/cm(x,t)£sm(x,t)x 

m 


(4.43) 


x  is  t/ie  vector  describing  the  overall  state,  x  is  a  particular  regular  polygonal  state,  and 
V).nf(x)  =  0.  TTiera,  i/: 


sup  { ^max  (^W^(£(A°)T^ 


—  min  4  (  1  — cos 

1  <i<N 

ge{- 1,0,1} 


2i7T 

~/V" 


^Tkm(p,t)  (cos(qam(p,t))-cos(qam(p,t)~ 

m.  '  '  / 


2ira7r\ 


<  0 
(4.44) 


for  some  g,  the  system  globally  converges  to  a  regular  polygon. 

Specifically,  if  f(x)  =  0  the  system  globally  converges  to  a  regular  polygon  formation  if: 


sup  V]  &m(p,  f)(cos(gam(p,  t))  —  cos(gam(p,  t)  —  2imn/N ))  >  0  (4.45) 

P>S  m 

Vge  {-1,0,1},  ie  {2,N  -  1}. 


Proof:  For  a  regular  formation  Vrnx  =  0,  Vrn£sm(x,  £)x  =  0,  then  Vrn(i (x)-]T)  kmCsm(x.,  £)x) 

0,  therefore  Mn  is  an  invariant  manifold  of  the  system. 

From  the  results  in  Section  A. 5.1  it  is  also  true  that  \{RC  km(x,  t)£sm(x,  t)CT1ZT}  > 

min  i<i<N  Xik  defined  in  eq.  A. 5.1,  and  that  if  1ZCXC1Z  <  0,  then  Kn1Zv£X £TZnKl  <  0 
gel-1,0,1} 

for  a  particular  matrix  X. 
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Thus,  if  condition  in  eq.  (4.44)  is  satisfied,  then  Vrn( 


Em  MX,  t)Csm(x,  t)m)VrTn  < 


0  and  therefore  x  exponentially  converges  to  x  G  A4n.  ■ 

If  f(x)  =  0,  the  above  conditions  in  f(x)  are  satisfied  and  the  global  convergence  to 
Vrnx  =  0  is  verified  for  specific  combinations  of  km(x,t),  am(x,t).  For  the  case  of  a  1- 
circulant  topology  L\,  if  k(x,t)  >  0  and  |ai(x, t)\  <  2 ir/N,  convergence  to  a  symmetric 
formation  is  guaranteed. 

Remark  4.2.2  The  Laplacian  Csm(x,t)  is  the  symmetric  part  of  the  Laplacian  Cm(x,t)  = 
Lm  0  R.From  the  properties  of  positive  negative  matrices  V AVT  <  0  iff  V(A  +  AT)VT  <  0. 

It  was  shown  that  the  manifold  JAn  is  an  invariant  manifold  of  the  cyclic  pursuit  control 
law  i?(a)(x[i+rraj  —  Xj),  then,  verifying  the  conditions  for  convergence  for  the  symmetric  control 
law  u  =  £  km(x.  t)(£m(x,  £)+£m(x,  t)T)x  is  a  direct  proof  of  convergence  to  circular  rotating 
formations  for  the  directed  topology  u  =  ^2  &m(x,  t)Cm{x,t)x,  with  asymmetric  control  law 
Ui  =  km(x.,t)R(a)(x[i+m j  —  Xj)  generalizing  the  results  for  cyclic  pursuit. 

This  last  result  verifies  the  convergence  to  rotating  regular  formations  resulting  for  k,a 
constants,  agreeing  with  the  results  obtained  through  linear  analysis  presented  in  [67,70,73]. 

Proposition  4.2.3  For  a  ring  topology  (L\),  if  |a|  =  n/N ,  the  formation  converges  to  a 
regular  polygon  with  a  constant  size 

Proof:  When  a  symmetric  configuration  is  achieved: 

Xj-fm  -  Xj  =  R(-2nm/N)(xi  -  Xj_m)  (4.46) 


Then 


Uj  =  i?(7r/iV)(xj+i  -  Xj)  +  i?(— 7r/Ar)(xj_1  -  Xj) 

=  R(n/N)(R(-2n/N)(xi  -  Xj_i))  +  i?(-7r/iV)(xj_1  -  Xj) 

=  i?(— 7r/iV)(xj  -  Xj_i)  +  R(-n/N)(xi-i  -  xf)  =  0  (4.47) 
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similarly,  for  a  more  general  cyclic  topology,  the  condition  for  km{x,t),  am(x,  t)  to  achieve  a 
regular  polygon  with  fixed  size  is  given  by: 

W  =  ^km(5L,t)(R(am(-x,t))(R(-2irm/N)(5L,ti  -  x,i[*-m])) 

m 

+R(-am(x,t))(x,t[i_m]  -  x,tt))  =  0 

=  Y  km(x-,t){R(am(iL,t)  -  ‘lirm/N)  -  R(-ccm(x,t)))  =  0  (4.48) 

m 

4.2.2  Distributed  global  convergence  to  a  desired  formation  size 

The  previous  section  addresses  the  problem  of  converging  to  a  formation  under  a  general 
cyclic  interconnection.  However,  the  subspace  to  which  convergence  is  defined  allows  for 
the  size  of  the  formation  to  be  an  uncontrolled  state  of  the  system.  In  general  the  problem 
of  global  convergence  to  a  splay-state  formation  using  only  neighbor  information  has  been 
sought  after  in  the  literature.  As  mentioned  in  the  introduction  we  consider  the  approach  to 
a  formation  without  constraining  the  relative  states  to  be  an  specified  vector. 

One  approach  that  converges  to  formations  without  specifying  fixed  relative  vectors  in  a 
global  frame  consists  of  using  structural  potential  functions  of  the  magnitude  of  the  distance 
to  the  neighbors  [64],  When  using  only  relative  magnitude  information,  if  the  interconnection 
is  not  a  rigid  graph,  the  global  convergence  to  the  desired  formation  is  impossible  due  to  the 
ambiguity  of  the  possible  equilibrium  configurations.  An  extra  piece  of  information,  allows 
our  approach  to  achieve  global  convergence  results,  namely,  the  agreement  on  an  orientation 
which  in  the  case  of  spacecraft  flight  can  be  achieved  by  individual  star  trackers.  In  the  case 
of  the  cyclic  pursuit,  an  approach  similar  to  the  one  presented  in  previous  work  [70],  where 
the  angle  of  the  formation  is  defined  as  a  dynamic  variable  that  depends  on  the  relative 
distance  to  the  neighbor  seems  a  reasonable  approach  however,  the  stability  results  are  only 
local. 
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In  this  section,  using  an  extension  to  the  approach  in  the  previous  section  we  present  a 
distributed  control  law  for  which  global  convergence  to  the  desired  size  can  be  guaranteed. 
Specifically,  we  determine  a  sufficient  condition  in  the  magnitude  of  an  arbitrary  function 
that  guarantees  convergence  to  the  desired  formation  from  any  initial  conditions. 

The  overall  structure  of  the  proof  consists  of  first  showing  that  a  sufficient  condition 
on  the  bounds  of  an  arbitrary  odd  function  f(x)  guarantees  convergence  to  a  symmetric 
formation,  i.e.  convergence  to  the  invariant  manifold  A4n.  And  then,  to  show  that  the 
trajectories  within  that  manifold  lead  to  a  formation  of  the  desired  size. 

Theorem  4.2.4  Global  convergence  to  a  regular  formation  of  a  desired  size 

Consider  a  set  of  agents  with  first  order  dynamics  x*  =  ip,  interconnected  under  an  undi¬ 
rected  cyclic  topology  with  control  law: 

Ui  =  Rn/N(xi+1  -  x<)  +  -  Xj)  +  /flxi+i  -  Xj|  -  p)(xi+ 1  -  x.-)  (4.49) 

where  f(z)  is  an  arbitrary  bounded  odd  function  of  z,  such  that  zf(z)  >  0  for  z  0  and 
/( 0)  =  0.  The  overall  dynamics  can  be  written  as: 

x  =  {—Cs  +  G(x))x  (4.50) 


Global  convergence  to  A4np,  the  manifold  of  regular  formations  with  intervehicle  distance  p, 
x  G  A4np  =  {x  :  Knx  —  0,  |xi  —  Xj|  =  p  Vi,  j}  is  guaranteed  if: 

^min(VrnTs(Vrn)T)  >  Ar/maa.Amax(K.nAi  (Vrn)T)  (4-51) 


where  Vrn  is  the  matrix  of  orthonormal  bases  forVTn,  Cs  isfihe  symmetric  circulant  rotational 

-I  I  0  .. 

Laplacian  defined  in  Section  4-1,  A\  is  the  matrix  A\  =  |  Q  0  0...  and  f(x)  <  frr 
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Proof:  To  start,  consider  the  following  two  lemmas: 


Lemma  4.2.5  The  manifold  A4n  is  a  flow-invariant  manifold  of  the  dynamics  in  eq.  (4.50) 

Proof:  It  has  been  shown  above  that  Mn  is  an  invariant  manifold  of  Cs,  namely 

VrnCs5i.  =  0  for  x  such  that  Vrn5t  =  0.  For  a  regular  formation  |xfc+i  —  x^|  =  |xi+i  —  xz| 
then  /(|xfc+i  —  xfc|  —  p)  =  /(|xi+1  —  Xj|  —  p),  and  thus  without  any  loss  of  generality  F(x)  = 
(/(|x2  -Xi|)Li  ®  J3)x. 

Then,  Vrn(-Cs  +  G(x))x  =  /(|x2  -  xi|)V;n(L1  <g>  J3)x  =  0.  ■ 

Lemma  4.2.6  eig(VrnAlsVZ)  =  eig(VrnAksVfln)  for  all  i,  k  G  {1, . . . ,  N},  where  Ais  =  (A{  + 
Aj).  Ai  =  <g>/3,  a)%s>  =  {of]}  £  RNxN  is  a  matrix  of  zeros  except  the  elements  of]  =  —  1, 

af]+ 1  =  1.  A\  was  explicitly  described  above. 

Proof:  eig(KrtTisVrr})  =  eig(VrnAksVfl,)  if  and  only  if  there  exists  a  similarity  transfor¬ 
mation  such  that: 

TVrnAisVZ  =  VrnAksVZnT  (4.52) 

Notice  that  TikAi  =  AkTkl  where  Tlk  =  Tki  =  (/„  —  Lk~i)  ®  h,  for  example,  in  the  case  of 
i  =  1,  k  =  2: 


0/0 
0  0  I 

10.. 


T12A1 


-II  0 
0  0  0 
0  0  0 


A2T?2  (4.53) 

0  0  0  ...  0  0  0.../ 

0-/  I  ...  I  0  0  ... 

(4.54) 

0  0  0  ...  0  1  0... 


and  correspondingly  TikAis  —  AksTki.  Then  we  have  that  VrnVrJt  =  /,  therefore  by  defining 
T  =  V  TVt  • 

±  Vrn±  v rn. 


and 


VrnAksVrrnT  =  VrnAksVZVrnTVZ  =  VrnAksTVl 


/rn-^-ks  v  rnv  rn 


(4.56) 


shows  the  desired  equivalence. 


Based  on  the  above  lemmas,  we  can  then  show  that  condition  (4.51)  guarantees  convergence 
to  the  invariant  manifold  Mn.  Specifically,  invoking  the  results  in  [110]  and  [68]  introduced 
in  Section  4.1  the  convergence  to  the  manifold  M.n  :  {x  :  Vrnx}  is  guaranteed  if  the  projected 
Laplacian  of  the  auxiliary  system  y  =  (— Cs  +  G(x))y  is  negative  definite,  i.e. 

Vm(-Ca  +  G{x))VZ<  0  (4.57) 


This  can  be  guaranteed  if 


^mm(K-n-^sKn)  >  (  Kn  G  (x) 


(4.58) 


Since 

N 

A max(VrnG(x)(Vrn)T )  =  ^max(Vrn  ^ /(xi+1  -  Xi)a4i(x)(Kn)T)  (4.59) 

i= 1 

^  N  fmax^max  (VrnMx)(Vrn)T)  (4.60) 

eq.  (4.51)  guarantees  eq.  (4.57)  and  thus,  convergence  to  M.n. 


Now,  it  is  shown  that  convergence  to  Mn  implies  convergence  to  Mnp.  Having  that 
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£x  =  0  then,  the  dynamics  of  the  distance  between  any  two  vehicles  in  A4n  are  given  by: 


d_ 

dt 


|xi+i  -  x» 


(Xj+l  -  Xj)T 
|Xi+i  Xj| 
(Xj+l  -  Xj)T 
|Xi+l  Xj| 
(Xj+l  -  X,)T 
|Xi+i  Xj| 
(Xj-f-l  -  Xx)T 


(xi+1  -  Xi) 

/ (|Xj+2  -  Xj+x |  -  p)(Xi+ 2  -  Xi+1)  -  /flXi+1  - 

(/(|xt+i  -  Xil  -  p)R27r/N(xi+1  -  Xi)  -  /(|xi+x 
(/(|Xi+l  -  Xi|  -  p)(R2ir/N  -  h)(Xi+l  -  Xi) 


|  Xi+1  -  X 

-  cos(7r/iV)/(|xi+i  -  Xi|  -  p)|xi+x  -  x. 


Xi|  -  /t»)(Xi+x  -  Xi) 

-  Xi|  -  p)(Xi+x  -  Xi) 


(4.61) 


defining  z  =  |xi+x  -  xz|  -  p: 


z  —  —  cos(n /N)f(z)(z  +  p). 


(4.62) 


A  Lyapunov  function  candidate  for  this  system  is  V  =  |z2,  yielding 


V  =  —  cos(n/N)zf(z)(z  +  p) 


(4.63) 


Since  f(z)  is  an  odd  function,  zf(z )  >  0  for  z  ^  0.  Furthermore,  z  +  p  =  |xi+i  —  Xj|  >  0,  so 
that  V  <  0.  Using  Lasalle’s  Invariant  Set  Theorem  [90],  the  system  (4.50)  globally  converges 
to  the  largest  invariant  set  where  V  =  0,  namely  M.np-  ■ 

Note  that  the  global  guarantee  in  this  control  approach  is  defined  by  an  upper  bound  on  the 
arbitrary  function  f(z).  This  bound  is  easily  implementable  by  a  saturation  function  or  an 
arctangent  function. 

The  two  results  presented  in  this  section  generalize  results  of  cyclic  control  approach 
to  nonlinear  systems.  Specifically,  we  introduce  an  analysis  approach  that  achieves  global 
guarantees  for  a  generalized  version  of  cyclic  pursuit,  which  includes  time- varying  and  state- 
dependent  gains  and  coupling  matrices  as  well  as  more  general  cyclic  interconnections.  Ad¬ 
ditionally,  we  introduce  a  decentralized  control  approach  with  global  convergence  guarantees 
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to  a  regular  formation  by  defining  upper  bounds  on  a  function  that  controls  the  separation 
between  vehicles. 


4.2.3  Extension  to  second  order  systems 

In  the  derivation  of  the  results  we  define  the  systems  as  first  order  systems.  In  general, 
for  space  applications  we  consider  control  approaches  for  second  order  systems.  This  section 
presents  an  approach  based  on  a  sliding  mode  control  that  shows  a  straightforward  extension 
of  the  first  order  integrators  to  more  complex  dynamics  when  there  is  knowledge  of  a  reference 
velocity  for  the  whole  formation. 

Let  again,  Xj(t)  =  [xiti(t ),xij2(t),xit3(t)]T  G  R3  be  the  position  at  time  t  >  0  of  the  ith 
agent,  i  G  {1,  2, . . . ,  n},  and  let  x  =  [x7,xj, . . .  ,xJ]T. 

Consider  a  linear  first  order  system: 

=  E  Aij  (xj  -  xd  (4.64) 

shown  to  converge  to  manifold  A4\. 

If  the  dynamics  of  each  agent  are  now  described  by  a  second  order  model: 

X*  =  Vf 

Vi  =  /(xi,Vi)  +  Ui  (4.65) 


consider  the  feedback  control  law: 


u i  =  -/(Xi,  Vi)  +  kd  Aj  (Xj  -  Xi)  +  ^2  Aj  (Vj  -  Vj)  -  kd  Vi,  kd  G  R>0-  (4-66) 

A  useful  form  to  describe  the  second  order  system  is  by  using  the  sliding  variables  defined 
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as: 


Si  =  kdXi  +  Vj  (4-67) 

Then,  the  dynamics  of  the  overall  system  (4.65)  with  control  law  (4.66)  can  be  written  as: 

X,  =  x:  Aj(kd(xj  -  Xi)  +  (Vj  -  Vi))  -  kdVi  (4.68) 

=  ^  Aij((kdXj  +  vj)  -  (kdXi  +  Vi))  -  kdVi  (4.69) 

Then,  the  system  dynamics  are  described  by  the  equations: 

Sj  =  'y  ^  Ajj(sj  ~Sj)  (4.70) 

Xj  =  -kdXi  +  Sj  (4-71) 

The  first  equation  describes  a  first  order  system  for  which  global  convergence  to  a  manifold 
M  C  R3  can  be  analyzed  following  the  approach  in  the  previous  sections,  the  second  equation 
is  an  stable  first  order  filter  with  input  Sj  and  output  Xj.  Then,  the  trajectories  of  the  agents 
under  control  law  (4.66)  are  the  filtered  response  of  trajectories  of  the  first  order  system. 
Under  the  control  law  in  eq.  (4.66),  the  physical  trajectories  converge  to  trajectories  which 
are  just  the  response  of  the  filter  Gkd(joo)  =  1 +jiCdUJ  t°  the  trajectories  of  the  first  order  system 
with  initial  conditions  s(0)  =  ^x(O)  +  x(0).  This  last  subsection  provides  an  approach  for 
the  implementation  of  the  control  laws  described  in  this  chapter  for  the  case  of  spacecraft 
formations,  where  f(x,  v)  can  be  a  local  description  of  the  gravitational  dynamics  with 
respect  to  some  reference  frame. 
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4.3  Convergence  Primitives  Approach 

In  this  section  we  present  an  approach  to  formation  control  based  on  the  combination  of 
primitives.  This  approach  is  an  extension  of  theorem  4.1.  Using  the  idea  of  primitives, 
controllers  that  converge  to  more  complex  subspaces  can  be  designed  and  their  global  con¬ 
vergence  properties  verified. 

Theorem  4.3.1  Consider  the  system: 


x  =  ^fi(x)  (4.72) 

i 

where  each  dynamic  primitive  fj(x)  has  an  invariant  manifold  A l*.- 

V*  :  R"  — »  RPi ,  V)fj(x)  =  0,  V^x  =  0,  V  x  G  Alj  (4.73) 

with  rank(Vi )  =  Pi. 

Then,  if  either: 

i.)  ^u£fi(x)VT  <  0  (4.74) 


ugpf 

nfv?  . 

. .  Vi  ^VT 

1  dx  n 

^v, 7  . 

ydfnyT 

2  dx  n 

<  0 

(4.75) 

v-$viT 

Kfr2T  . 

y'JfnyT 
'  ‘  Vn  dx  Vn 

where  span{VT}  =  span{ [V)7 Vff  ...VrJ]}.  Then: 

x  ->  P|  Adi  as  t  — »  oo 


(4.76) 


Proof:  For  the  first  condition  consider  x,  a  particular  solution  such  that  0  =  Vjx  = 
VjX.  =  ...  =  Vnx.  Since  V  is  full  row  rank,  there  exists  a  linear  transformation  V  =  TV  where 
V  is  an  orthonormal  partition  of  R"  and  TV AVtTt  <  0  V AVT  <  0.  Then,  if  condition 

(A. 29)  holds,  the  system  y  =  Vx  is  contracting  with  respect  to  y  and  any  trajectory  of  the 
system  y  converges  to  the  same  solution,  namely  x  — >•  x  €  =  D 

For  the  second  sufficient  condition,  consider  the  auxiliary  system: 


yi 

Vi 

y2 

V 

y« 

yn_ 

x, 


(4.77) 


then: 


yf  =  S  ^(nTy*  + 

k 


(4.78) 


V  =  TVi,  where  Vj  are  orthonormal  projections  of  the  state  such  that  VVj  =  IPi,  and 
VTVi  +  UjUi  =  In.  Since  rank ( Vt )  =  p,,  T  is  an  invertible  matrix.  The  Jacobian  of  the 
system  y  with  respect  to  y  is: 


VitV?  ■ 

1/  dfnVT 

1  dx  n 

.  V>^pVT 

1  dx  n 

Vn^V? 

y  IfayT 

n  dx  n 

(4.79) 
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which  can  be  written  as: 


diag[Ti ] 


u£uT  ngv?-  ...  Vifi-v'/ 
U&vqT  u£v?  ...  nfvg 


iiai/'.Tj] 


T 


r„£v? 


n  dx 


■T 


(4.80) 


and  diag[Tj]  is  an  invertible  transformation,  such  that  TV AVTTr  <  0  if  and  only  if 
VTAVT  <  0.  Then,  the  negative  definiteness  in  eq.  (4.75),  proves  the  global  convergence  to 
y  =  0,  i.e  x  -►  x  G  =  fl,  M-  ■ 

Notice  that  additionally,  if  V ■§^ii{x)VT  <  0  then  V  ]T\  Jjfi(x)VT  is  at  least  semidefinite 
negative.  If  one  of  the  summation  terms  is  positive  definite  or  if  the  summation  is  full  rank, 
it  is  positive  definite. 


Corollary  4.3.2  Consider  a  set  of  N  agents  with  dynamics  x,  =  tq  grouped  in  sets  Ss  s  £ 
{m,n,nm},  and  a  set  of  control  laws  um  —  fm(x),un  =  /n(x),wmn  =  /mn(x)  corresponding 
to  each  group  where  fs  (x)  depends  only  on  elements  of  set  Ss  and  has  corresponding  invariant 
manifolds  Ais  with  respective  set  of  transformations  Vs,  for  which  Vsfs  =  0. 

Control  law  fm  interconnects  agents  in  set  Sm  C  S,  control  law  fn  interconnect  agents  in 
the  set  Sn  C  S,  Sm  fl  Sn  =  0,  and  control  law  fnm  interconnect  agents  in  set  Sn  and  Sm . 

If  fs,  individually  converge  to  their  invariant  subspaces  M.s,  i.e.  Vs ^ Vj  <  0  for  all 
i,  then,  a  sufficient  condition  for  the  global  convergence  of  the  system  x  =  ^)s/s(x)  to  the 
subspace  A4  =  Alt  is: 

_Mi  +  dirT)v,T  v&v? 

for  all  k,l  G  s.  This  result  can  be  extended  to  more  than  two  sets  of  disjoint  groups  n,m  with 
interconnecting  links  nm. 


<  0 


(4.81) 
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Proof:  Since  n  gn  —  0,  Vnfm  =  0,  the  Jacobian  has  a  block  tridiagonal  structure: 


vj^vz 

T /  dfrnl  T/T 
fix  vml 

0 

0 

0 

v^-bvZ 

Y  .dimly T 

K»f£^T 

0 

0 

0 

T  A  dfml  T/T 

fix 

0 

0 

T/  dfnp  rrj 
dx 

ydU_VT 

Vn  dx 

(4.82) 


given  the  block  tridiagonal  structure  the  positive  definiteness  result  can  be  verified  by 
verifying  the  positive  definiteness  of  the  lower  dimensional  matrices  following  the  next  propo¬ 
sition.  ■ 


Proposition  4.3.3  A  block  tridiagonal  matrix  with  positive  block  entries  An: 


All 

A12 

0 

0 

0 

A2I 

A22 

A23 

0 

0 

0 

A32 

..  ^ 

CO 

CO 

A34 

0 

(4.83) 

0 

0 

0  Anj„_i 

^71,71 

and  An  >  0?  Ann  >  0,  is  positive  definite  if  the  submatrices 


A  = 


An  2 Aj  i 


i,i+ 1 


2  A,  4.1  A  A; 


i+l,i 


(4.84) 


are  positive  definite. 
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Proof:  By  partitioning  the  space  as  x  =  \x\  x2  2n],  the  quadratic  form  is: 


xTAx  =  xjAiiXi  +  xf(Ai2  +  Af1)x2  +  xfA22X2Jt-xl{A2^  +  Al2)x2  +  xjAzzx3  +  ... 

=  ^xjAnXi  +  ^xfAx  1  +xf(A12  +  Ajx)x2  +  )^%A22x2  +  \X2A2 2X2  + . ..  +  ^xfAxn 


_  _ 

T 

r  -| 

r  . 

T 

r  1 

1 

1 

Xi 

An  2.4x2 

r  1 

1 

X2 

A22  2A23 

+  9 

\Xi  x2 

+  9 

x2  x3 

Z 

X2_ 

2A21  A22  _ 

L  J 

A 

_X3_ 

2A^2  A33 

...  +  -xfAxn 


(4.85) 


which  is  positive  if  the  condition  in  eq.  (4.84)  is  met.  ■ 

In  the  next  section,  we  illustrate  the  application  of  the  results  in  this  section  with  a  series 
of  examples  where  application  of  the  theorem  and  the  discussed  corollaries  give  insight  into 
the  construction  of  different  convergence  mechanisms. 


4.4  Applications 

In  a  first  example  we  present  a  useful  application  of  the  analysis  approach  to  define  a  decen¬ 
tralized  control  algorithm  based  on  a  set  of  primitives  whose  global  convergence  properties 
can  be  verified  from  the  results  of  theorems  4.3.1  and  4.1.1. 

Example  4.4.1  Global  convergence  to  time  varying  formation  with  only  relative 
information 

Consider  a  formation  flight  mission  where  we  are  interested  in  achieving  a  cubic  for¬ 
mation  with  each  one  of  the  vehicles  in  a  vertex  of  the  cube  and  allow  the  cube  to  rotate 
perpendicular  to  one  of  the  faces  with  time  varying  angular  velocity  c o(t).  This  is  the  case 
for  example  of  a  formation  continuously  tracking  a  point  on  the  ground  while  following  an 
orbit  around  the  planet. 

The  following  control  approach  is  proposed:  Consider  the  group  of  8  agents  x*,  1  €  {1,  ..8}, 
with  agent  groups  defined  as  Si  =  {si, S2---;  sm},  <Si  =  {1, 2, 3, 4}, £12  =  {3, 4, 6, 5}, S2  = 
{5, 6,  7, 8},  and  a  control  law  based  on  sets  of  vehicles  Si  and  S3,  following  the  cyclic  pursuit 
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dynamics: 


uSi  =  ku(t)Ri(t)(xSi+1  -  xSi)  for  Si  G  SUS2  (4.86) 

with  kw  =  cj(t)/(2sin(7r/4)).  and  for  SV2  a  time  varying  coupling  control  law  that  converges 
to  a  planar  square  formation: 

uSi  =  h  ( Ri(t)(xSi+1  -  xSi )  +  (t)(xSi_1  -  xSi))  for  Si  G  (4.87) 

where  Ri(t)  G  M3*3  is  a  rotation  that  can  vary  its  principal  axis  with  time.  Namely,  the 
rotation  matrices  can  be  defined  as  Ri  =  Ti{t)Rn/fT^ (t),  where  T\  is  a  constant  arbitrary 
direction  matrix  (we  can  assume  Ti  =  I  without  loss  of  generality),  T2  =  T1;  and 

0  —sin  (</>(t))  cos  (<f(t)) 

T\2  (t)  =  o  cos  (f(t))  —sin  (4>(t)) 

1  0  0 

where  we  assume  <f(t)  =  u{t)  >  0. 

The  dynamics  of  the  overall  system  are  defined  asx  =  A(t)x,  and  the  constraints  defining 
the  convergence  subspace  M.  =  {x  :  V(t)x  =  0},  V(i)T  =  Vff  V. '2  V^(t)T  where,  in  as 
similar  manner  to  eg.  4-19: 

y .  =  0K«  (4.89) 

H  =  [ofc6  *„£«>]  (4.90) 

Vy.it)  =  06x3  K,t£i'tTvl(i)  06x3  (4-91) 

where  we  use  the  notation  T  =  In  xT  and  Ai  can  be  shown  to  be  a  flow  invariant  manifold 
since  (V(t)  +  V A(t))x  =  0. 
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From  theorem  4.3.1  and  theorem  4.1.1  we  have  a  way  to  numerically  verify  sufficient 
conditions  for  the  global  convergence  and  stability  to  the  desired  subspace,  namely  it  defines 
constraints  in  the  minimum  value  of  ki  as  a  function  of  the  upper  bound  in  the  magnitude 
of  u(t),  namely  u)max  >  |cu(t)|  such  that: 

sup  (y(t)V(i)T  +  V(t)A(t)V(ty)  <  0 

*  '  ’ 

To  see  how  this  is  true,  notice  that  Vi  =  0,  =  0,  and 

^12 (t)  =  06x3  [u(t)X]  Ti2(t)  06x3 

=  Cj(t)  06x3  Kn£(4)[z*}f12(<f>)  06x3  :=w(*W) 

0  0-1 

where  [ zx ]  is  the  skew-symmetric  matrix  In®  0  0  0 

1  0  0 

Since  V(t)  =  V(<f>(t))  then  V{4>)A(4>)V{4>)T  =  VAVT  is  obviously  a  constant  because  the 
reference  frame  is  arbitrary. 

D((i))V{cj))T  can  be  verified  to  be  positive  semidefinite,  the  above  condition  can  be  guar¬ 
anteed  if: 

Umax  \  max  (D(cf>)V(4>)T)]  <  VAVr  (4.95) 

The  term  in  brackets  can  be  numerically  calculated  for  a  given  gain  ki ,  thus  defining  an 
upper  bound  in  umax  for  which  global  convergence  is  guaranteed.  Figure  4-3  shows  the  time 
history  of  the  control  approach  converging  to  formation  and  achieving  the  desired  rotating 
configuration. 

As  a  second  example  that  illustrates  the  application  to  derive  convergence  properties  for 
general  control  a  formation  of  vehicles  surrounding  a  target  is  studied: 


(4.92) 

(4.93) 

(4.94) 
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Figure  4-3:  Agents  converge  to  a  cube  in  3D.  (Snapshots  every  30  seconds). 


122 


Example  4.4.2  A  regular  formation  surrounding  an  (un)cooperative  target  Con¬ 
sider  a  system  of  n  +  1  agents,  n  of  them  with  dynamics  as  in  eq.  4-35,  and  a  leader  agent 
with  state  xi  that  uses  information  from  all  others  and/or  all  other  agents  use  information 
from  it: 


xi  =  /p(x  i,x)  (4.96) 

^  =  i?(xm -Xi)  +  i?T(xi_i -Xi)  +  /C(xi-Xi)  (4.97) 


i  —  {2,  and  some  general  functions  fc,  fp  with  fc(0)  =  0.  DenotexJ  =  [xj ,  xj, . . . ,  xJ]T. 

The  overall  dynamics  can  then  be  written  as: 

Xi 

x 


/p(x  l,x) 
£x  +  /c(x,xx) 


m 


(4.98) 


The  interest  here  is  to  determine  convergence  to  the  subspace  defined  by  Vf  =  0,  where: 


V  = 


0 


v„ 


(4.99) 


where  ln  E  Rn  is  a  vector  of  ones,  [nT  —  1^  ®  /]  is  a  projection  matrix  into  a  subspace 
where  the  target  is  in  the  center  of  the  formation  and  Vrn  is  the  projection  to  the  subspace  of 
regular  polygons  in  eq.  4-19.  Considering  the  following  results: 


£(ln®J)  =  0, 
di 

Vm-£[ln®I}  =  0 


(4.100) 

(4.101) 
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It  is  then  found  that: 


ydFyT  = 
V  d£V 


V  TV  1  4-  V  ^ V  1 

vrn^'vrn  '  Vrndx.  v rn 

n^p-VT 

n  dx  Vrn 


n 


X'f&L  _  4-  n2(^-  - 

2-/j  v  dxj  dx,  '  '  '  dxi  dxi  ' 


dfp 
dx  i 


dxi  • 


(4.102) 


Then,  if  ^  <  0,  a  sufficient  condition  to  surround  the  target  is: 


y{^_^r)  +  nA_Ml.)<0 

axj  axj  axi  axa 

i 


(4.103) 


iVofe  that  fc,  fp  are  arbitrary  functions  and  the  result  gives  a  sufficient  condition  to  achieve 
the  mission  objective  in  terms  only  of  the  gradients  of  fp  and  fc. 


In  the  next  example  we  consider  a  fragmented  aperture  application,  where  individual 
telescopes  are  deployed  in  an  arbitrary  configuration  and  the  objective  consists  on  achieving 
convergence  to  a  formation  where  in  its  final  configuration  the  vehicles  are  as  close  as  possible 
to  each  while  maintaining  a  minimum  separation  between  them  to  achieve  the  recreation 
of  a  full  aperture  composed  by  many  small  segments.  The  problem  is  related  to  the  two- 
dimensional  sphere  packing  problem  and  a  solution  can  be  described  by  a  series  of  concentric 
hexagonal  formations.  In  this  example,  a  distributed  control  law  based  on  theorem  4.3.1  is 
proposed  and  sufficient  conditions  for  global  converge  to  such  configuration  with  any  number 
of  spacecraft  are  derived. 


Example  4.4.3  Convergence  to  a  packed  formation.  Consider  a  set  of  agents  with 
first  order  dynamics  xt  =  ul;  grouped  in  M  sets  Si  of  6  vehicles,  and  consider  the  input: 

Ui  =  i^/6(xi+ 1  -  Xi)  +  i?J/6(xi_!  -  X;) fm  for  i  E  Sm  (4.104) 

Sm  being  a  group  of  size  6,  m  G  M}.  This  input  was  shown  to  make  the  system  of 

agents  x*,  i  Si  converge  to  manifold  :  {V6x  =  0}  of  regular  hexagonal  formations. 
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Now,  consider  interconnection  control  laws  between  the  different  sets  Si: 


uk  =  R^/z{^k+x  ~  xfc)  +  i?J/3(xfc_i  -  xfc)  =  £ mi  for  k  G  Smi ;  (4.105) 

Smi  being  a  group  with  3  agents,  some  agents  in  Sm  and  some  in  Si,  which  has  been  shown 
to  converge  to  triangular  formations  such  that  A43  :  {V73x  =  0}. 

The  constraints  of  the  desired  convergence  subspace  are  Vm  =  [Ke  04X6]>  Vi  =  [O4X6  Ke]> 
and  the  corresponding  link  constraints  Vrni  =  [v1; . . . ,  vn],  vn  G  M3x3,  vm\  =  —I,,  vm2  = 

I  +  #2^/3,  Vn  =  —Ritx/z  for  some  ml,  m2  G  Sm,  H  G  «Sj. 

The  Jacobians  will  be  denoted  as  ^  =  Ag. 

Then,  from  theorem  4-3-1  and  corollary  4-3-2  showing  global  convergence  to  a  grid  de¬ 
fined  by  a  pair  of  concentric,  aligned  hexagonal  patterns  Sm  and  Si  with  three-agent  link 
interconnections  between  them  Smi,  requires  showing  that: 

VmAmVj  Vm(Ami  +  AffjVfh 
Vmi(Am  +  VmlAmlV^ 

and , 

VmlAm,V^,  Vml(A,  + 

V,(Aml  +  Aj)VZ  V,A,V? 

(4.106) 

where  =  L®R  +  LT  ®RT,  with  L  G  Mnxn. 

The  remarkable  value  of  this  result  is  that  it  directly  verifies  global  convergence  for  any 
number  of  rings  with  corresponding  interconnecting  links  and  the  overall  global  convergence 
of  the  system  is  verified  by  the  result  in  eq.  4-106. 

Figure  4-4  shows  an  example  of  the  convergence  for  such  a  controller  in  a  scheme  with 
three  hexagonal  rings.  Agents  in  Si  =  {1, . . . ,  6};  S2  —  {7, . . . ,  12}  <S3  =  {13, ... ,  18}  con¬ 
verge  to  hexagonal  formations.  Formations  S12  =  {!,7,2},<Si2  =  {5, 4, 10},  <Si3  =  {6, 17, 12},  S13  = 


Vr3£^Vrl  Vml(A,  +  A^Vj 
V^+Aj^  VeC^Vj 


V„,CKlKl  VJAlld  +  Ajn)  I'T 

V^  +  A^jVZ  vzc^v? 
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{3, 4, 9},  establish  links  that  define  a  manifold  M  =  Mi  corresponding  to  a  regular  sphere 
packing  grid. 

To  close  this  section,  an  example  is  presented  where  the  result  guarantees  global  conver¬ 
gence  to  a  desired  size  of  formation  when  the  size  is  commanded  by  one  of  the  spacecraft 
using  only  relative  information  to  its  neighbor  (s). 

Example  4.4.4  Leader  based  convergence  to  desired  size.  Consider  a  system  of  n 
agents  with  a  control  law  4-35  and  a  leader  that  controls  its  separation  to  other  agents  by  a 
control  law  f(d)  such  that: 

Ui  =  R(ir/N){xi+i  -Xi)  +  f?(7r/iV)T(xi_1-xi)  i  =  2,3.JV  (4.107) 

ux  =  JR(o)(x2-Xi)  +  .R(a)T(xiv-x1)  +  /r(||x2-x1||2-p)(x2-xi)  (4.108) 

where  fr(p )  is  a  positive  function  of  p  with  equilibrium  point  0  such  that  fT{ 0)  =  0.  Then, 
the  system  exponentially  converges  to  a  symmetric  formation  with  interagent  separation  p. 

Proof:  The  principle  of  the  proof  is  to  show  that  the  dynamics  of  an  auxiliary  system 
y  =  V (x)  are  contracting,  and  y  —  0  is  a  particular  solution  of  the  system. 

Consider,  the  overall  dynamics  of  the  system  of  single  integrators  with  control  law  4-107: 

x  =  — £.sx  +  /r(x)J41x  (4.109) 


where  Cs  is  the  Laplacian  defined  in  previous  section  which  converges  to  regular  formations 


and  Ai 


-I  I  0 
0  0  0 


Consider  the  auxiliary  variables 


Vi 

Kx 

yi 

/r(x) 

(4.110) 
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Figure  4-4:  Agents  converge  to  a  packed  grid  by  imposing  some  convergence  constrains  shown 
by  the  arrows,  two  different  cases  can  be  designed  following  the  same  argument. 
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where  VrV  +  UTU  =  I,  CsUTUx  =  0,  which  define  an  nonlinear  invariant  manifold  Ainp  : 
{x  |  Fx  =  0,  /r(x)  =  0},  since  x  =  0  for  x  G  A4r.  Their  dynamics  are  given  by: 


in 

v± 

V(-CsyL  +  y2Aix) 

(Vx/r)x 

(Vx/r)(— £sx  +  y2Ai'x) 

in 

-VCSVT  VA& 

9i 

>> 

U-, 

II 

(4.111) 

= 

92 

-(Vx/r)£sFT  (Vx/r)AlX 

92 

The  auxiliary  system  (4-111)  is  contracting  and  all  trajectories  will  converge  to  the  same 
trajectory  if: 


F  =  0— 0-1  <  0  (4.112) 

dy 

Specifically  y  =  0  is  a  solution,  then,  any  trajectory  of  system  (4-111)  converges  toy  =  0, 
which  means  that  any  solution  of  (4-109)  converges  tox£  M.np- 


V  and  Vrn  are  related  through  an  invertible  transformation  V  =  TVrn,  and  consider  an 

\i  ol 


invertible  transformation  that  commutes  with  T,  i.e  0  = 


where  0  >  0  G  R. 


0  0 


Then,  TO^O-^tt  -  0T^Tt0-1  <  0  F  <  0. 


Then,  a  sufficient  condition  for  convergence  of  system  (4-109)  to  a  regular  formation  with 
characteristic  size  p  is: 


Jy 


-VrnCsVrTn 

-0(Vx/r)£,t£ 


6  1VrnAix. 


(Vx/r)ylix 


<  0 


(4.113) 
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(4.114) 

(4.115) 


(Vx/r)j4iX  +  ^(Q^VmAiX  —  ^((Vx/r)£sV^))(Vrn^sK.n)_1^(^_1^rn^.lX  —  0((Vx/r)£sV^))T  <  0 
=*  \  (x2  X!)t  (a  -  202|^)  (V^V^-i  (^1  -  2 e2^L>y  (x2  -  xx) 

<  -202^-(x2  -xi)2 

^  i  [(Dl  -  2«2f  ■ D)  (c'  -  2*2f  D)]  <  -2*2f 7 

(4.117) 


D  =  D2CsVrTn. 

which  verifies  that  the  negative  definiteness  of  Jy  does  not  depend  on  the  value  of  x.  If 
for  a  particular  value  of  x,  a  constant  transformation  0  is  found  which  verifies  the  negative 
definiteness  it  holds  uniformly. 

Then,  the  satisfaction  of  the  two  above  conditions  is  sufficient  to  guarantee  convergence 
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in  terms  of  For  example,  for  =  1,  N  =  5,  ©  = 
to  any  desired  size  of  formation. 


I  0 
0  0.5 


,  verifies  global  convergence 


4.5  Summary  and  Conclusions  of  the  Chapter 

This  section  presented  an  approach  to  the  cyclic  pursuit  laws  in  the  context  of  contraction 
theory.  By  doing  so,  a  wider  perspective  to  analyzing  the  convergence  properties  of  decen¬ 
tralized  control  approaches  that  lead  the  formation  to  subspaces  or  submanifolds  of  the  state 
space  instead  of  converging  to  fixed  points  was  devised. 

Some  of  the  results  are  in  the  form  of  sufficient  conditions  that  are  to  be  verified  nu¬ 
merically,  but  several  important  results  are  obtained  as  a  direct  derivation  of  the  approach, 
namely,  nonlinear  control  laws  that  verify  global  convergence  to  a  regular  formation  of  spe¬ 
cific  size  as  a  function  of  upper  bounds  of  a  scalar  function,  convergence  results  to  time 
varying  formations  as  a  function  of  the  variation  rate,  laws  that  can  extend  the  convergence 
properties  to  an  infinite  number  of  interconnected  basic  blocks  by  showing  convergence  to  a 
basis  formation  block,  or  by  allowing  a  straightforward  derivation  of  non-intuitive  necessary 
conditions  to  achieve  a  specific  mission  that  can  be  defined  as  convergence  to  a  manifold  as 
in  the  case  of  deriving  conditions  to  surround  a  non-cooperative  vehicle  as  illustrated  in  an 
example. 

The  approach  to  analyzing  dynamical  systems  via  contraction  theory  departs  from  the 
most  common  Lyapunov  analysis  and  appears  to  be  more  fit  for  the  case  of  nonlinear  dis¬ 
tributed  systems,  and  more  specifically  systems  with  circulant  interconnections. 
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Chapter  5 


Comparison  of  the  Generalized  Cyclic 
Approach  to  Relevant  Architectures 

5.1  Introduction 

As  mentioned  in  the  introductory  chapter,  the  synthesis  of  a  controller  with  arbitrary  in¬ 
formation  structure  has  been  widely  studied  and  remains  still  an  open  problem.  Solving 
for  an  optimal  controller  is  a  convex  problem  only  for  very  specific  information  structures. 
An  important  part  of  the  work  on  this  thesis  presented  in  previous  chapters  aims  to  define 
controllers  that  achieve  better  performance  with  reduced  complexity  in  some  specific  mission 
scenarios. 

The  basis  of  the  approach  proposed  in  this  thesis  considers  controllers  that  maintain 
a  formation  by  converging  to  a  manifold  instead  of  tracking  relative  trajectories  to  other 
vehicles.  One  expects  that  by  allowing  some  extra  degrees  of  freedom  the  control  effort  will 
be  reduced  as  compared  to  approaches  that  track  relative  trajectories  and  constraint  more 
degrees  of  the  system.  Evidence  of  this  effect  has  been  noticed  in  the  experimental  results 
in  Chapter  6,  showing  an  improvement  as  compared  to  other  architectures. 

The  objective  of  this  section,  therefore,  is  to  justify  and  highlight  the  importance  of 
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the  control  approach  based  on  cyclic  approach  in  a  more  theoretical  manner.  This  is  done 
by  considering  a  benchmark  formation  control  problem  and  comparing  the  advantages  and 
disadvantages  of  different  control  architectures  in  a  more  analytical  trade  space  framework. 

As  metric  of  performance,  a  common  quadratic  norm  that  weights  the  performance  error 
and  the  control  effort  is  traded  with  the  cost  of  implementing  the  control  architecture  in 
terms  of  complexity  in  as  well  as  the  cost  of  being  robust  enough  to  a  failure. 


5.2  Benchmark  Problem 

A  simple  benchmark  problem  is  considered.  This  problem  encompasses  the  concept  of  for¬ 
mation  maintenance  focusing  on  simple  integrator  dynamics,  but  the  approach  could  be 
extended  to  more  general  cases  under  some  specific  assumptions.  The  problem  is  simpli¬ 
fied  for  the  purpose  of  the  analysis,  by  considering  the  agents  with  individual  homogeneous 
dynamics: 


Xj  =  Ax*  +  Buu{  +  BwWi 


(5.1) 


and  for  simplicity  for  our  purpose  we  assume  Bu  =  /,  Bw  —  I,  Cy  =  I  and  A  =  —el.  For 
the  objective  of  comparing  the  performance  of  controllers  maintaining  a  certain  shape  of  the 
formation,  we  assume  a  regular  polygon.  In  that  case,  the  performance  can  be  described  by: 

=Cx  (5.2) 


I  I  T  Riir/n  B-2-n-/n  0 

0  I  I  T  R‘2tt /n  B‘2n/n 


Depending  on  the  control  architecture,  the  different  vehicles  in  the  formation  will  be 
required  to  perform  calculations  to  issue  their  control  commands.  In  the  first  place  each 
vehicle  has  to  obtain  the  state  information  from  itself  and  from  other  vehicles  which  it  requires 
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to  calculate  the  control  commands.  The  trade  analysis  model  in  this  chapter  considers  a  unit 
operation  per  state  to  be  received  and  a  single  unit  operation  per  state  to  be  transmitted. 
Whether  the  state  information  from  other  vehicles  is  obtained  through  communications  or 
through  measurements  is  irrelevant  to  the  model,  but  further  research  could  analyze  different 
situations  including  differences  between  such  scenarios. 

Using  the  input  information  each  vehicle  calculates  the  control  commands.  Such  cal¬ 
culation  is  assumed  in  our  model  as  a  matrix  multiplication  operation  and  is  modeled  as 
the  size  of  the  gain  matrix  for  each  respective  vehicle.  Then,  if  the  commands  need  to  be 
communicated  to  others  vehicles  the  same  scheme  is  considered,  assuming  a  unit  per  each 
command  to  be  transmitted. 


5.3  Synthesis  of  Decentralized  Controllers 

In  general,  the  control  synthesis  problem  can  be  described  as,  given  a  plant  G,  find  a  con¬ 
troller  K  while  minimizing  a  desired  metric  of  the  system  J  =  \\f(P,  K)\\.  This  metric 
defines  the  control  objective.  As  mentioned  in  the  introduction,  for  our  case  we  are  going 
to  analyze  the  performance  of  the  system  in  terms  of  a  quadratic  metric  that  considers  the 
control  effort  and  the  error  in  the  desired  configuration.  The  results  in  this  section  consider 
a  continuous  system  with  state  feedback. 

The  trade  is  based  on  studying  the  controllers  that  minimize  a  quadratic  cost  function 
of  the  error  and  the  control  effort: 

poo 

J  =  /  ztQz  +  uTRudt  (5.3) 

Jo 


for  a  system  with  dynamics: 


x  =  Ax-  +  Bu  u  +  Bw  w 


(5.4) 
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and  error  defined  as  z  =  CiX. 

Consider  the  dynamics  of  the  closed  loop  system: 

x(t)  =  {A  +  BuK)x  +  Bi  w 


(5.5) 


with  output: 

z  (t)  =  {C  +  DK)x 

with  C  =  CiQ1/2,  R  =  DTD,  then  the  metric  of  interest  is  the  square  of  the 

2-norm  from  input  w  to  output  z. 

Given  a  system  G  with  state  space  description  A,  B,  C,  0,  the  2-norm  from  input  to  output 
is  given  by: 


INI2  = 

4;  Tr{P‘(iu)P(ju)}du 

(5.6) 

which  by  Plancherel’s  Theorem  is: 

INI2  = 

POO 

/  Tr{B*eAHC*CeAtB}dt 

Jo 

(5.7) 

= 

Tr{B*Y0B} 

(5.8) 

where  Ya  =  /0°°  eA*tC*CeAtdt  is  the  observability  gramian,  which  can  be  shown  to  be  the 
solution  to  the  lyapunov  equation: 

A*Y0  +  YaA  +  C*C  =  0  (5.9) 

hence,  the  optimal  solution  to  an  unstructured  controller,  can  be  obtained  by  solving  the 
above  equation. 

For  some  very  specific  cases,  the  structure  of  the  controller  can  be  derived  directly  from 
properties  of  the  system.  In  a  centralized  scheme,  there  are  no  restrictions  on  the  structure 
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of  K ,  and  a  solution  of  the  above  equation  is  calculable  though  a  variety  of  methods.  On 
other  cases,  if  A,  B,  C,  Q  and  R  belong  to  a  matrix  algebra,  it  is  straightforward  to  show 
that  Ya  and  the  optimal  controller  K  =  — BR~lY0 ,  belong  to  the  same  algebra  [56].  Thus, 
for  example,  if  A  and  C  are  rotational  circulant  matrices  (see  sec.  2.1)  and  Q,R,B  are  a 
constant  time  the  identity,  all  of  them  belong  to  the  algebra  C7Z  and  thus  the  controller  is 
rotational  circulant. 

However,  for  a  general  structure  of  K  accounting  for  the  underlying  information  trans¬ 
fer  structure,  the  problem  is  not  convex,  and  even  solving  for  a  feasible  solution  can  be 
a  challenging  problem.  Some  structures,  like  cyclic  or  leader  follower  structures  can  be 
implemented  as  convex  constraints,  however,  for  many  cases  the  degree  of  freedoms  in  the 
structure  of  the  controller,  the  best  we  can  do  is  solve  for  a  constant  that  multiplies  a  unitary 
Laplacian  such  that  K  =  kL. 

Since  the  purpose  of  this  chapter  is  to  compare  optimal  performances  for  different  ap¬ 
proaches,  we  only  consider  topologies  for  which  we  can  solve  for  an  optimal  solution  under 
the  same  Q,  R  weights.  Thus  we  restrict  to  solving  for  the  optimal  control  problem  under 
a  fix  structure  times  a  constant  K  =  kL,  where  L  defines  the  structure  of  the  decentralized 
controller. 

In  that  case  the  ||GW_>Z|  =  Tr{Ya}\,  Ya  is  given  by: 

(A  +  kL)*Y0  +  Y0(A  +  kL)  +  (C  +  kDL)*(C  +  kDL)  =  0  (5.10) 

which  is  a  convex  function  of  k,  and  a  minimum  can  be  found.  Figure  5-1  shows  the  J  as  a 
function  of  k  highlighting  the  minimum  for  different  architectures. 

The  structures  considered  in  the  analysis  are: 

1.  Centralized  control  In  this  case  the  computation  of  the  control  commands  is  per¬ 
formed  in  one  of  the  vehicles.  It  requires  knowledge  of  the  states  of  all  the  other  vehicles 
in  the  formation  which  can  be  either  measured  or  communicated.  It  also  needs  to  corn- 
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k 

Figure  5-1:  Optimal  Cost  as  the  number  of  vehicle  increases 

municate  the  commands  to  each  one  of  them  as  well.  In  this  case  the  only  essential 
vehicle  is  the  central  controlling  unit. 

2.  Parallel  implementation  of  the  controller  This  is  a  common  approach  presented 
in  the  literature  [29,92],  which  is  decentralized  in  the  sense  that  it  does  not  require 
a  unique  vehicle  to  issue  the  control  commands,  each  vehicle,  individually  calculates 
its  own  commands  based  on  knowledge  of  the  overall  formation  state.  It  requires 
measuring  the  state  of  all  the  other  vehicles  in  the  formation  but  no  vehicle  is  essential 
to  the  operation  of  the  control  architecture.  We  assume  that  the  state  estimate  of  the 
formation  among  all  the  vehicles  is  equivalent  and  the  performance  can  be  equivalent 
to  the  centralized  approach. 

3.  Synchronized  individual  regulation  with  a  global  reference  frame  In  this 
case,  the  formation  requires  an  external  coordination  mechanism,  e.g.  GPS  informa¬ 
tion,  which  allows  them  to  track  individual  points  and  have  accurate  synchronized 
timers  to  achieve  the  desired  formation.  In  this  case  the  vehicles  do  not  require  any 
communication  between  them,  but  require  individual  measurement  to  a  global  refer¬ 
ence  frame  and  a  time  coordination  mechanism. 
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4.  Relative  fixed  trajectory  regulation  This  is  the  approach  described  in  the  intro¬ 
ductory  chapter,  related  to  the  consensus  problem  which  has  been  widely  studied  and 
is  very  common  approach  to  decentralized  formation  control.  In  this  case,  each  vehicle 
requires  information  of  only  its  neighbors  as  dictated  by  the  specific  interconnection 
topology  in  order  to  calculate  its  own  control  commands.  Consider  the  consensus-like 
approach  where  an  individual  controller  is  given  by: 

Ui  =  '^2  hj  (xj  -  Xj  -  hji),  (5-11) 

je  M 

and  hij  are  the  agreement  biases  as  described  in  section  2.2.3.  Then  the  overall  closed 
loop  system  is: 


x  =  (A  —  Mj)x  +  w  (5.12) 

where  x  describes  the  overall  description  of  the  formation  and  w  is  a  vector  of  uncorre¬ 
lated  disturbances.  The  interconnection  between  vehicles  defined  by  a  matrix  £,  then, 
finding  an  optimal  controller  with  a  given  topology  reduces  to  an  optimization  on  the 
parameter  k. 

We  consider  the  following  interconnection  topologies,  for  which  an  optimal  controller 
can  be  derived  via  solving  an  LMI: 

5.  Generalized  pursuit  1-circulant  cyclic  topology  In  a  parallel  approach,  consider 
the  manifold  approach  described  in  eq.  4.35.  In  that  case  the  controller  can  be  written 
as: 


u i  =  R(*j  ~  *i),  (5.13) 

ieN 

where  R  is  a  rotation  matrix  such  that  V(A  +  fc£)x  =  0  for  Vic  =  0  and  the  overall 


137 


Table  5.1:  Different  topologies  considered  for  comparison  of  decentralized  controller 
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Figure  5-2:  Optimal  Cost  as  the  number  of  vehicle  increases 


structure  of  the  closed  loop  system  is: 


x  =  (A  —  A:£s)x  +  w 


(5.14) 


where  x  describes  the  overall  state  of  the  formation,  and  w  is  a  vector  of  uncorrelated 
disturbances.  The  interconnection  between  vehicles  defined  by  a  matrix  Cs  —  L  (g)  R  + 
LT  ®  RJ. 

Figure  5-2  shows  the  solution  to  the  optimization  problem  for  different  considered  archi¬ 
tectures  as  the  number  of  vehicles  increases.  It  can  be  noticed  that  as  the  number  of  vehicles 
increases  the  centralized  control  is  always  the  most  favorable  in  terms  of  performance  opti¬ 
mality. 


5.4  Cost  Metrics 


In  the  previous  section,  we  consider  only  a  quadratic  performance  metric,  and  the  obvious 
result  is  that  a  centralized  controller  is  the  best  approach  if  we  are  only  concerned  about  the 
performance  in  terms  of  error  and  fuel.  However,  one  of  the  major  drivers  of  the  research  in 
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decentralized  control  is  that  the  effective  realization  of  centralized  approaches  becomes  more 
difficult  or  impossible  as  the  number  of  vehicles  increases. 

The  incurred  cost  in  the  realization  of  a  centralized  architecture,  is  mainly  due  to  the  cost 
of  communicating  all  the  team  information  to  and  from  one  single  unit  and  processing  all 
that  information  in  the  same  unit  for  every  control  period.  This  justifies  a  first  cost  metric 
in  the  trade  analysis.  This  Cost  of  implementation  ( Costj )  metric  considers  the  maximum 
number  of  operations  in  any  single  unit  at  every  control  period.  The  metric  is  defined  as: 

Cost  i  =  ma xC/(i) 

i 

Cliff)  =  Nopsi  +  Ncmrii  +  Nsensi 


where  NopSi,  Nconii .  NsenSi  are  the  estimated  number  of  algebraic  operations,  number  of 
communication  operations  and  number  of  estimation  operations  on  the  ith  vehicle. 

Another  disadvantage  of  the  centralized  approach,  mentioned  in  the  introductory  chapter, 
is  the  risk  of  failure  of  the  overall  formation  if  any  one  of  the  vehicles  fails,  specifically,  if 
the  central  control  unit  or  the  communication  to  or  from  it  fail,  the  whole  control  scheme  is 
doomed.  A  way  to  circumvent  such  situation  is  by  allowing  more  than  one  of  the  spacecraft 
the  same  capabilities.  This  is  the  justification  of  a  second  metric  considered  in  this  study 
which  accounts  for  the  the  expected  cost  of  an  extra  unit  to  achieve  robustness  to  a  failure. 
This  Cost  of  robustness  metric  is  defined  as: 


Cr  ^  ^  ^iP fail  f)Cj (f ) 


Where  p jaii  is  the  failure  probability  of  a  specific  unit  %  and  r,t  is  a  parameters  that  define 
how  ’critical’  role  in  achieving  control  i  is  and  for  our  analysis  we  set  it  to  be  r*  G  {0, 1} 
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5.5  Results 


Figure  5-4  presents  a  trade  space  of  the  performance  of  different  architecture  versus  the  cost 
of  complexity  as  the  number  of  vehicles  in  the  formation  is  increased. 

The  following  conclusions  can  be  drawn: 

•  A  centralized  approach  is  optimal  and  the  optimal  performance  per  vehicle  does  not 
depends  on  the  number  of  vehicles 

•  For  every  case,  the  cyclic  controller  is  a  non-dominated  solution 

•  Among  all  non  centralized  solutions,  the  cyclic  approach  has  the  best  performance, 
however  if  the  only  metric  of  concern  is  the  cost  of  implementation,  there  are  topologies 
cheaper  to  implement,  for  example  a  chain  topology,  or  each  vehicle  tracking  individual 
coordinated  trajectories.  This  last  one  however,  assumes  that  the  cost  of  having  a 
common  global  reference  frame  is  negligible  (as  might  be  the  case  of  GPS  for  LEO 
formations) 

•  Under  the  defined  metric,  the  centralized  solution  is  dominated,  particularly,  having 
multiple  instantiations  of  the  controller  has  better  robustness  (in  the  sense  of  surviving 
a  failure). 

•  If  the  performance  and  robustness  to  failures  are  metrics  of  importance,  the  cyclic 
approach  that  converges  to  a  manifold  of  regular  formations  is  the  predominant  archi¬ 
tecture 

•  For  formations  with  large  number  of  vehicles,  the  performance  difference  between  a 
generalized  cyclic  controller  with  convergence  to  regular  formations  and  a  cyclic  topol¬ 
ogy  tracking  relative  trajectories  tends  to  vanish 
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Figure  5-3:  Trade  space  Performance  vs  Complexity  of  Implementation  as  a  function  of  the 
number  of  vehicles  in  the  formation 
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Figure  5-4:  Trade  space  Performance  vs  Cost  of  Robustness  as  a  function  of  the  number  of 
vehicles  in  the  formation 
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Chapter  6 


Experimental  Results:  Decentralized 


Formation  Flight  in  Microgravity 
Environment 

6.1  Introduction 

The  SPHERES  testbed  provided  a  hardware  platform  for  validating  the  formation  flight  al¬ 
gorithms  in  a  relevant  space  environment.  The  experimental  demonstration  of  the  formation 
control  algorithms  and  the  validation  of  their  expected  properties  were  achieved  by  imple¬ 
menting  cyclic  pursuit  control  laws  and  testing  them  in  a  relevant  hardware  platform  in  the 
microgravity  environment  aboard  the  International  Space  Station.  The  experiments  present 
the  first  known  implementation  of  decentralized  formation  flight  in  space. 

The  performance  of  the  algorithms  as  a  formation  control  strategy  was  verified  while 
demonstrating  their  capabilities  to  accomplish  several  simulated  mission  scenarios  relevant 
for  a  fractionated  spacecraft  mission.  Such  scenarios  are  specifically  inspired  by  DARPA’s 
system  F6  mission  objectives. 

The  F6  (Future,  Fast,  Flexible,  Fractionated,  Free-Flying  Spacecraft  United  by  Informa- 
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tion  Exchange)  mission  (http://www.darpa.mil/tto/programs/systemf6/index.html)  mission 
is  currently  in  development.  Its  objectives  include  demonstrating  the  advantages  and  feasi¬ 
bility  of  fractionated  spacecraft  on  a  near-Earth  environment.  Among  the  milestones  to  be 
achieved  in  order  to  validate  formation  flight  feasibility  are  array  initialization,  satellite  ad¬ 
dition  maneuvers,  collision  avoidance  and  rejection  maneuvers.  The  experiments  performed 
on  SPHERES  addressed  some  of  the  issues  for  such  mission  scenarios  using  decentralized 
cyclic  pursuit  algorithms,  testing  the  reliability  and  verifying  the  important  properties  of 
this  approach  to  formation  control. 

This  chapter  is  structured  as  follows:  the  first  section  describes  the  SPHERES  testbed 
and  the  implementation  of  the  algorithms,  a  second  section  describes  the  performed  tests 
and  their  results,  a  third  section  uses  experimental  data  from  the  different  tests  to  verify 
and  quantify  the  performance  of  the  implementations  of  the  algorithm  and  compare  their 
performance  to  other  control  approaches. 

6.1.1  The  SPHERES  testbed 

SPHERES  (Synchronized  Position  Hold  Engage  Reorient  Experimental  Satellites)  are  an 
experimental  testbed  consisting  of  a  set  of  small  vehicles  with  the  basic  functions  of  a  satellite. 
Three  of  them  are  aboard  the  International  Space  Station  and  are  operated  by  the  astronauts 
in  a  test  volume  that  allows  6D0F  microgravity  maneuvering.  The  operational  volume  is 
approximately  a  cube  of  about  lm  x  lm  x  lm. 

There  are  also  three  identical  vehicles  on  the  ground  that  can  perform  2D  maneuvers  by 
means  of  frictionless  sliding  air  bearings.  This  vehicles  operate  on  a  flat  table  and  are  used 
for  a  first  level  validation  of  the  algorithms  before  sending  them  to  the  ISS. 

The  propulsion  system  of  a  SPHERES  vehicle  consists  of  12  microthrusters  that  use 
compressed  CO2  gas.  The  microthrusters  are  controlled  by  solenoid  valves  that  can  achieve 
pulses  between  10  to  180ms  at  each  control  period.  Each  thrusters  delivers  0.1  IN.  The  wet 
mass  of  each  SPHERE  on  the  ISS  is  approximately  4.3 kg. 
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Figure  6-1:  Picture  of  three  SPHERES  satellites  performing  a  test  on  board  the  ISS.  (Foto- 
credit:  NASA  -  SPHERES) 

The  metrology  system  of  the  SPHERES  emulates  a  global  positioning  system  by  calcu¬ 
lating  its  position  and  velocity  with  respect  to  a  fixed  frame  by  measuring  the  travel  time 
of  synchronized  ultrasound  signals.  Each  vehicle  has  a  local  estimator  that  calculates  its 
global  position  based  on  ultrasound  and  IMU  measurements  with  an  accuracy  of  approxi¬ 
mately  2mm.  This  metrology  system  can  also  be  used  to  calculate  the  relative  range  and 
bearing,  and  corresponding  rates  to  a  beacon  in  another  vehicle.  Such  mode  of  operation 
in  intended  to  allow  experimentation  using  pure  relative  information.  In  the  tests  presented 
on  this  thesis  however,  relative  measurements  were  synthesized  from  communicated  states 
as  the  vector  difference  of  each  vehicles  global  estimate.  This  simplification  is  irrelevant  to 
the  verification  of  the  control  performance. 

A  single  RF  channel  is  used  to  communicate  the  state  between/among  spacecraft  and 
the  ground.  The  communication  is  TDMA  based,  and  allows  for  a  small  bandwidth  for 
transmission  within  each  control  period. 

Figure  6-1  shows  a  picture  of  three  SPHERES  spacecraft  aboard  the  ISS. 

The  dynamics  of  each  spacecraft  are  well  approximated  by  a  double  integrator.  The 
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control  commands  calculated  by  the  control  law  are  the  desired  forces  which  are  converted 
into  open  loop  pulse  times  of  a  set  of  thrusters  to  achieve  the  desired  force  by  a  control 
allocation  (mixing)  algorithm. 


6.2  Algorithm  Implementation 

The  algorithms  were  implemented  in  C,  the  standard  programming  language  of  the  testbed 
and  packed  as  a  library  for  the  SPHERES  science  utility  module. 

Three  different  versions  of  the  control  algorithm  were  implemented  and  tested  on  different 
experiments  performed  at  different  stages  of  its  development. 

On  a  first  implementation,  a  velocity  tracking  inner  loop  was  used  as  an  approximated 
implementation  of  the  single  integrator  dynamics,  in  this  case  the  control  algorithm  was 
setup  as: 


f i  =  -m'y{kdR(a)(-ki+l  -  xt)  -  v»)  (6.1) 

where  fh  is  the  mass  of  the  vehicle,  x,  and  v4  are  position  and  velocity  variables  from  the  local 
estimator,  xi+1  is  a  communicated  estimated  position  variable  from  the  estimator  in  vehicle 
i  +  1  and  7  and  kd  are  control  gains,  kd  is  a  time  scaling  which  defines  the  angular  speed  of 
the  formation  rotational  motion  and  7  is  a  regulation  gain  that  dictates  the  behavior  of  the 
velocity  tracking.  This  controller  is  basically,  the  simplistic  approach  to  double  integrator 
dynamics  described  by  Ren  [75]. 

This  implementation  requires  the  agreement  on  an  inertial  frame  to  which  v  is  measured 
with  respect  to,  an  agreement  on  a  global  orientation  and  does  not  consider  feedforward 
terms.  It  does  not  require  an  agreement  on  an  origin  of  coordinates  since  it  only  requires 
relative  position  measurements. 

An  important  consideration  for  implementation  is  the  discrete  nature  of  the  actual  system 
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in  the  selection  of  the  gain  7.  In  a  theoretical  sense,  for  the  continuous,  unperturbed  case, 
large  values  of  7,  improve  the  tracking  performance  of  the  velocity  regulation,  however,  in 
a  discrete,  saturation  constrained  implementation,  large  gains  can  easily  turn  the  system 
unstable.  For  the  experiments,  the  gain  was  selected  considering  the  limitations  of  the 
testbed  by  selecting  it  such  that  the  settling  time  of  the  velocity  tracker  is  about  1  period. 

A  second  implementation  considers  a  more  correct  approach  to  second  order  systems 
by  adding  a  feedforward  term  which  improves  the  performance.  This  is  specifically,  the 
approach  presented  in  section  3.32,  by  setting  up  the  force  to: 

f i  =  —fh(/ykgR(a)  (xj+i  -  Xj)  +  kgR{wi+ x  -  vf)  -  7 v;  -  k cXj)  (6.2) 

In  this  case,  the  gain  7  was  tuned  by  considering  the  rejection  of  a  2  cm  disturbance 
over  a  control  period  and  the  value  of  kg  was  setup  to  achieve  the  desired  angular  speed  for 
each  specific  scenario.  Notice  that  for  this  implementation  too,  an  agreement  on  a  reference 
velocity  to  which  v  is  measured  with  respect  to  and  an  agreement  on  a  global  orientation 
are  required  but  not  an  agreement  on  the  origin  of  coordinates. 

The  third  version  used  in  the  experiments  considers  the  approach  in  Section  3.42,  which 
was  implemented  as: 

fi  =  —  m(kiR(a)(dii  +  dk  2)  +  k2R(2a)dv\)  (6-3) 

where  dxq  =  xi+2— Xj,  dk  1  =  x.;+2  — xt,  dv  1  —  v.J+ 1  —  Vj  are  synthesized  relative  measurements 
where  Xj  and  v*  are  from  the  local  estimator,  kj ,  Vj  are  communicated  estimated  state 
variables  from  the  estimator  in  vehicle  j.  Aq,  and  A;2  were  selected  to  achieve  circular  or 
spiral  motion  with  the  desired  angular  velocity. 

As  described  in  the  theoretical  results,  in  this  implementation,  the  vehicles  do  not  require 
any  global  positioning  information,  only  an  agreement  on  a  global  orientation.  It  is  to  note 
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that,  for  real  missions,  this  agreement  on  the  orientation  can  be  achieved  through  star 
trackers,  and  therefore  this  approach  seems  useful  for  deep  space  missions. 

The  tests  were  designed  as  a  sequence  of  maneuvers  using  one  of  the  above  described 
implementations  and  will  be  described  in  the  next  section.  Every  test  starts  with  standard 
estimator  convergence  and  initial  positioning  maneuvers.  Each  vehicle  is  programmed  with 
a  role  defining  a  unique  identifier  and  in  the  description  below.  The  vehicle  loaded  with  role 
i  will  be  referred  as  spacecraft  i  or  SPHi. 

Videos  of  experimental  results  can  be  accessed  online1. 


6.3  Description  and  Results  of  the  Tests 

The  experiments  present  the  first  known  implementation  of  decentralized  formation  flight  in 
space.  The  main  objective  of  these  experiments  was  to  demonstrate  the  use  of  the  decentral¬ 
ized  algorithms  as  a  formation  control  tool  for  several  mission  scenarios.  In  a  first  test,  the 
decentralized  properties  of  the  algorithm  to  achieve  a  formation  and  achieve  easy  addition 
of  modules  were  verified.  The  vehicles  performed  circular  maneuvers,  elliptical  maneuvers, 
and  a  joining  maneuver.  In  a  second  set  of  test  we  verified  the  practical  implementation  of  a 
controller  that  uses  only  relative  information  to  maintain  a  formation  achieving  circular  and 
Archimedean  spiral  formations.  In  later  tests  we  use  the  cyclic  pursuit  algorithm  to  achieve 
reconfiguration  of  the  maneuver  when  a  failure  is  detected.  In  other  tests  the  algorithm  was 
implemented  with  a  heuristic  collision  avoidance  mechanism  that  addresses  some  of  the  risks 
associated  with  collision  while  converging  to  a  formation  from  an  arbitrary  initial  position. 
In  a  last  set  of  experiments  presented  in  this  chapter,  a  simulation  of  a  deployment  scenario 
is  presented  where  each  vehicle  joins  a  circular  formation  in  the  order  and  timing  manually 
selected  by  the  crew  member. 

1http: //ssl.mit.edu/ spheres /video/ CyclicPursuit 
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6.3.1  Test  1:  Joining  maneuver  2-sat  to  3-sat  formation 

The  test  described  in  this  section  was  performed  during  test  session  14C,  in  November  2008. 
It  was  designed  as  a  sequence  of  maneuvers  intended  to  incrementally  build  on  complexity 
following  the  general  guideline  protocol  for  testing  on  SPHERES.  The  main  idea  was  to  test 
the  algorithm  achieving  a  circular  formation  with  two  vehicles,  then  add  a  third  one  and 
then  achieve  elliptical  trajectories.  For  this  test  the  cyclic  pursuit  algorithm  was  implemented 
following  control  law  in  eq.  6.1. 

After  initial  estimator  convergence  and  positioning  the  test  was  designed  to  achieve  the 
following  maneuver  sequence: 

1.  Two  spacecraft  perform  a  rotation  maneuver  in  the  x-z  plane  with  a  radius  r  =  0.3m; 

2.  A  change  in  the  desired  radius  is  commanded  and  the  spacecraft  spiral  out  to  achieve 
a  circular  formation  with  r  =  0.4m; 

3.  A  third  spacecraft  joins  the  formation  and  the  system  reconfigures  into  a  three-spacecraft 
evenly-spaced  circular  formation  with  r  —  0.35m; 

4.  A  similarity  transformation  T  is  applied  to  the  rotation  matrix  in  a  way  that  the 
spacecraft  achieve  an  elliptical  formation  with  eccentricity  0.8. 

The  initial  positioning  was  x\  =  [0,  —  0.1,  —  0.2]r,  aq  =  [0, 0.1,  0.2]T,  x$  —  [0, 4,  0]T  with 
zero  initial  velocity  (with  respect  to  the  ISS). 

6.3.1. 1  Test  1  (P237  -T2)  results 

Data  from  telemetry  shows  the  formation  achieving  the  defined  sequence  of  maneuvers.  In 
figure  6-2  the  global  position  and  velocity  time  history  is  shown.  The  time  history  of  the 
states  is  depicted  for  each  spacecraft  (with  respect  to  the  ISS).  In  fig.  6-3  the  trajectories 
performed  by  the  spacecraft  during  the  maneuvers  1),  2),  3)  and  4)  are  shown. 
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After  a  successful  initial  positioning  of  the  three  satellites  at  75  seconds,  SPH1  and 
SPH2  start  moving  to  eventually  achieve  a  circular  rotating  formation  (Fig.  6-3a).  In 
the  next  maneuver  (Fig.  6-3b),  after  spiraling  out  to  achieve  a  larger  formation  size,  the 
vehicles  asymptotically  converge  to  a  constant  radius  until  the  next  maneuver  (Fig.  6-3c)  is 
initiated.  In  that  next  maneuver,  satellite  3  joins  and  a  new  radius  is  achieved.  A  profile 
plot  is  also  presented  which  shows  the  satellites  converge  from  different  x  —  z  planes.  In  this 
maneuver  the  topology  is  reconfigured.  SPH2  changes  its  target  from  SPH1  to  SPH3,  SPH3 
starts  following  SPH1  and  a  natural  reconfiguration  occurs.  In  a  last  maneuver  (Fig.  6-3d), 
a  transformation  is  applied  to  the  control  law  as  described  in  sec,  3.5.2  and  the  vehicles 
achieve  a  slightly  elliptical  formation  with  eccentricity  0.8. 

The  experimental  results  (see  in  particular  Fig.  6-3)  present  the  first  demonstration 
of  the  effectiveness  of  the  proposed  cyclic-pursuit  controllers.  It  verified  the  modularity 
properties  of  the  algorithm  in  the  sense  that  each  vehicle  was  running  the  exact  same  code, 
and  the  coordination  was  achieved  by  defining  the  interconnection  topology.  It  additionally 
experimentally  verified  the  extension  to  achieving  elliptical  formations. 

6.3.2  Test  2:  Convergence  to  3-sat  formation  from  arbitrary  initial 
conditions 

This  second  test,  like  to  the  previous  one,  was  performed  during  test  session  14C  in  November 
2008.  Again,  for  this  test,  the  cyclic  pursuit  algorithm  was  implemented  following  control 
law  in  eq.  6.1.  The  sequence  of  maneuvers,  after  initial  estimator  convergence  was  defined 
as: 

1.  Three  spacecraft  achieving  a  evenly-spaced  rotation  maneuver  in  the  x-z  plane  with 
radius  r  =  0.35m; 

2.  After  75  seconds,  a  similarity  transformation  T  is  applied  to  the  rotation  matrix  for 
the  spacecraft  to  achieve  an  elliptical  formation  with  eccentricity  equal  to  0.8. 
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Figure  6-2:  Experimental  results  from  Test  1:  Position  and  velocity  vs.  time.  From  left  to 
right:  satellites  1,  2  and  3.  Maneuvers  indicated  by  numbers. 


Figure  6-3:  Experimental  results  from  Test  1:  x-z  plane.  Sequence  of  maneuvers  a)  Maneuver 
1  ,  b)  Maneuver  2,  c)  Maneuver  3  and  d)  Maneuver  4. 
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Figure  6-4:  Experimental  results  from  Test  2:  Position  and  velocity  vs.  time.  From  left  to 
right:  satellites  1,  2  and  3. 


6.3.2. 1  Test  2  (P237  -T6)  results 


Figure  6-4  shows  the  time  history  of  the  global  position  and  velocity  of  each  spacecraft  (with 
respect  to  the  ISS)  from  telemetry  data;  while  fig.  6-5  shows  the  trajectories  achieved  by  the 
spacecraft  during  the  maneuvers  1)  and  2).  The  results  demonstrate  the  controller  achieving 
its  objective  of  converging  from  an  arbitrary  initial  position  into  a  3-sat  rotating  formation. 

It  is  important  to  notice  that,  the  formation  converged  to  a  larger  size  than  the  designed 
0.35m.  A  similar  behavior  was  observed  in  test  1.  This  effect  is  explained  as  a  consequence 
of  the  discretization  and  delays  effects  and  the  lack  of  a  feedforward  term.  Specifically,  the 
value  of  a  (from  Section  3.2.4),  at  the  equilibrium  state  has  to  be  less  than  ir/N  in  order  to 
maintain  a  non  expanding  formation.  This  means  that  the  nonlinear  term  \\xi+i  —  Xt||  —  p 
is  greater  than  zero,  and  thus  ||xi+i  —  %i\\  >  p  when  a  stable  size  is  achieved.  In  the  later 
tests  we  show  how  this  situation  is  improved  when  adding  a  feedforward  term  and  in  the 
conclusions  section  we  address  how  other  improvements  could  achieve  even  more  precise 
results. 
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Figure  6-5:  Experimental  results  from  Test  2:  x-z  plane.  Sequence  of  maneuvers  a)  and  b). 


6.3.3  Test  3:  Pure  relative  formation  maintenance 

This  test  validated  the  decentralized  algorithm  based  on  the  cyclic  pursuit  approach  that 
uses  only  relative  measurements  to  maintain  a  formation.  This  test  was  performed  during 
test  session  20,  in  December  2009.  In  this  test,  the  control  approach  in  eq.  6.3  was  used.  In 
the  previous  implementations  of  cyclic  pursuit  algorithm,  the  distributed  controller  relies  on 
measurements  of  relative  positions  but  required  an  agreement  on  the  velocity  of  the  inertial 
frame.  In  this  version  of  the  controller,  the  commands  are  issued  based  exclusively  on  relative 
measurements  to  the  neighbors.  This  characteristic  is  of  important  value  for  deep  space 
formation  flight  applications.  The  algorithm  to  be  used  in  this  test  is  an  implementation  of 
the  cyclic  pursuit  algorithm  for  double  integrator  dynamics  with  only  relative  information. 
The  constants  k\,  k2  were  defined  to  achieve  an  angular  speed  of  u>  =  2n /I20rad/ sec.  After 
the  first  45  seconds  are  for  estimator  convergence  and  initial  positioning,  the  sequence  of 
maneuvers  was  defined  as  following: 

1.  In  the  first,  active  maneuver  the  satellites  position  themselves  60  centimeters  from  each 
other  in  opposite  directions  from  the  center  of  the  test  volume  and  an  initial  formation 
acquisition  maneuver  using  the  cyclic  pursuit  algorithm  from  previous  test  sessions 
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achieve  a  circular  formation. 


2.  After  40  seconds  into  this  maneuver  the  controller  in  both  satellites  switches  to  the 
control  law  described  in  eq.6.3  with  parameters  k  1,  k2  to  achieve  an  spiraling  maneuver 
under  free  drift  mode. 

3.  When  reaching  a  radius  of  50cm,  the  controller  switches  to  maintain  a  circular  forma¬ 
tion  including  a  mode  controlling  the  center  of  the  formation, 

4.  After  40  seconds  the  controller  mode  switches  to  free  drift  mode  with  parameters  k\, 
k2,  a  to  achieve  circular  formation  (using  only  relative  measurements)  and  allows  the 
center  of  the  formation  to  drift  free. 

5.  Lastly,  a  stopping  maneuver  finalizes  the  test. 

6.3.3. 1  Test  3  (P282-T3)  results 

The  satellites  performed  the  specified  maneuvers,  achieving  the  desired  relative  motion  in 
the  x-y  plane,  i.e.  relative  circular  and  spiral  trajectories.  This  test  successfully  validates 
a  new  type  of  controller  inspired  by  the  cyclic  pursuit  algorithm,  which  uses  only  relative 
position  and  velocity  information  of  neighbors  to  converge  to  a  desired  relative  motion. 

The  distributed  control  laws,  shows  the  desired  performance  and  convergence  properties 
to  achieve  an  overall  desired  formation  behavior  in  the  x-y  plane.  A  discernible  result  from 
hardware  implementation  is  however,  that  the  relative  motion  in  the  z  direction  showed  very 
slow  convergence  to  the  desired  state  due  to  a  suspected  constant  disturbance  in  the  +Z 
direction. 

The  implemented  control  law  shows  a  slow  convergence  because  of  too  low  gains  assigned 
for  the  z-motion  control  which  is  the  direction  perpendicular  to  the  formation  maneuvers  and 
is  completely  decoupled  from  the  cyclic  pursuit  control.  From  eq.  3.42  it  can  be  noticed  that 
the  dynamics  in  the  z-direction  are  decoupled  of  the  other  coordinates.  The  relative  dynamics 
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Figure  6-6:  Experimental  results  from  Test  3:  Sequence  of  maneuvers  indicated  by  colors. 

in  such  direction  reduce  to  a  dynamic  consensus  which  should  converge  to  an  agreement  in 
the  z-positions,  if  the  gain  is  large  enough  [77],  Therefore,  the  gains  for  z-motion,  could  have 
been  independently  assigned  from  the  gains  for  x-y  motion. 

For  the  purposes  of  this  thesis,  the  important  result  is  the  validation  of  the  performance 
in  the  x-y  plane.  As  mentioned,  the  x-y  motion  is  decoupled  from  the  z  motion,  which 
is  described  by  consensus  dynamics  under  disturbances,  which  have  been  studied  in  other 
contexts  and  are  out  of  the  scope  of  this  thesis. 

In  Figure  6-6,  the  relative  motion  in  the  x-y  directions  is  shown  performing  the  different 
maneuvers.  The  figure  shows  the  relative  state  of  the  satellites  as  a  function  of  time  as  well 
as  the  control  commands  on  each  vehicle.  The  underperformance  of  the  controller  in  the 
z-direction  is  evident  when  the  free  drift  mode  is  active.  In  the  maneuvers  1  and  3  in  figure 
6-7,  the  center  of  mass  is  free  and  it  is  noticeable  how  both  vehicles  drift  in  the  positive  Z 
direction. 

This  experiment  was  the  first  experimental  validation  of  the  cyclic  pursuit  approach  that 
relies  only  on  relative  information  to  control  a  circular  and  spiral  formation. 
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Background  telemetry  states  (standard),  Sphere  logical  ID  1 
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Figure  6-7:  Experimental  results  from  Test  3:  Position,  velocity  and  control  commands  vs. 
time. 
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6.3.4  Test  4:  Implementation  with  a  fault  detection  and  recovery 
algorithm 

The  purpose  of  this  test  was  to  verify  a  cyclic  pursuit  algorithm  as  a  responsive  control 
method  to  achieve  reconfiguration  maneuvers  in  a  satellite  formation  in  the  event  of  a  failure. 
This  test  used  a  communication  failure  detection,  isolation  and  recovery  (FDIR)  algorithm 
demonstrated  in  tests  run  in  previous  test  sessions  developed  as  part  of  parallel  research  on 
formation  flight  at  MIT  space  systems  lab. 

A  feature  of  the  implemented  algorithm,  is  the  setup  of  a  logic  algorithm  that  reconfigures 
the  topology  of  the  formation.  Based  on  this  logic,  each  vehicle  decides  the  vehicle  that  it 
uses  as  a  partner  to  control  its  state.  In  this  case  it  uses  knowledge  of  a  global  variable  which 
is  updated  through  communication  by  the  fault  detection  and  identification  mechanisms,  but 
current  research  aims  to  identify  the  formation  overall  state  through  local  knowledge. 

When  a  vehicle  is  rejected  because  a  failure  was  detected,  a  set  of  the  parameter  that 
defines  the  formation  and  the  formation  changes  automatically  reconfigures  into  a  new  con¬ 
figuration.  In  this  test,  for  the  purposes  of  algorithm  demonstration,  the  reconfiguration 
consists  only  on  a  change  to  a  parallel  formation  plane.  In  a  more  realistic  implementation 
the  idea  can  be  applied  to  a  more  general  set  of  parameters  that  define  a  reconfiguration  to  a 
formation  that  optimizes  some  specific  metric,  for  example,  minimizing  collision  probabilities 
with  the  unresponsive  vehicle. 

In  all  the  following  tests  the  implemented  controller  is  an  improved  implementation  of 
the  cyclic  pursuit  algorithm  that  includes  a  feedforward  term,  specifically  6.2. 

The  sequence  of  maneuvers  after  estimator  initialization  and  initial  positioning  in  this 
test  was  defined  as  follows: 

1.  At  55  seconds,  a  3-satellite  rotating  formation  in  the  x-y  plane,  with  center  on  the 
2  =  0.2m  plane  is  commanded. 

2.  At  120  seconds,  a  failure  is  simulated  in  SPH1,  by  blocking  the  transmission  of  data. 
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In  response  to  this,  SPH2  and  SPH3  should  change  the  formation  plane,  specifically 
to  the  z  =  0 m  plane. 


6.3.4. 1  Test  4  (P273-4)  results 


The  results  from  this  test  demonstrated  a  complete  fault  detection  isolation  and  recovery 
mechanism  for  multi-vehicle  formations  under  a  simulated  failure  and  even  under  an  actual 
failure.  The  awareness  of  the  state  of  the  communication  link  with  the  other  satellites  in 
each  vehicle  is  monitored  by  the  fault  detection  module.  The  plots  on  the  left  in  Figure  6-8 
,  show  the  perception  of  the  transmitters  for  each  one  of  the  satellites.  0  means  nominal 
operation,  1  means  a  failure  was  detected.  The  black  line  describes  the  number  of  satellites 
in  the  formation  for  each  satellite.  The  simulated  failure  in  the  transmitter  of  SPH1  (SPH1) 
is  indicated  by  the  thin  line  at  120  seconds.  5  seconds  later,  the  detection  algorithm  on 
each  vehicle  detects  that  there  is  a  failure  seen  in  the  change  of  the  variable  defining  the 
perception  of  the  state  of  the  transmitter  (TX1)  from  0  to  1. 

The  detected  failure  triggers  a  reconfiguration  maneuver  in  the  controller  module,  which 
commands  a  change  in  the  configuration  of  the  interconnection  links  and  moves  the  center 
of  the  formation  in  a  way  that  avoids  the  failed  vehicle.  The  number  of  vehicles  in  the 
formation  is  used  by  the  decentralized  algorithm  to  define  the  formation  parameters.  At 
about  125  seconds  satellite  1  reconfigures. 

An  actual  failure  was  detected  and  addressed  by  the  algorithm.  At  about  160  seconds, 
SPH2  reset.  SPH1  and  SPH3  detected  the  failure.  SPH3  then  reconfigures  its  formation 
parameters  and  changes  planes  again. 
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Perception  of  Formation  by  Sat1 


Perception  of  Formation  by  Sa^ 


Figure  6-8:  Experimental  results  from  Test  4.  Top:  perception  of  the  formation  by  each 
satellite. 
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6.3.5  Test  5:  Implementation  with  a  collision  avoidance  mecha¬ 
nism 

This  test  was  designed  to  evaluate  the  performance  of  a  combination  of  algorithms  to  achieve 
formation  initialization  avoiding  any  possible  collision.  A  high  level  algorithm  commands 
the  formation  acquisition  and  maintenance  using  the  cyclic  pursuit  decentralized  algorithm. 
In  case  of  a  potential  collision,  a  low  level  collision  avoidance  algorithm  overrides  the  high 
level  controller  to  prevent  trajectory  overlaps.  The  algorithm  assumes  that  a  vehicle  has 
a  detection  system  capable  of  detecting  position  and  velocity  of  nearby  objects.  For  the 
experimental  setup,  each  vehicle  was  given  the  information  of  the  other  satellites  via  com¬ 
munication. 

The  test  sequence  was  the  following  after  estimator  convergence  and  initial  positioning: 

1.  SPH1  and  SPH2  start  a  circular  formation  maneuver.  SPH3  holds  position  at  a  point 
that  interferes  with  the  path  of  the  formation  of  SPH1  and  SPH2. 

2.  After  a  few  seconds  into  this  maneuver,  SPH1  and  SPH3  detect  a  possible  collision 
with  each  other  and  the  collision  avoidance  algorithm  on  each  one  executes  a  path 
correction. 

3.  Ten  seconds  after  the  execution  of  the  collision  avoidance  maneuver  in  SPH3  has  oc¬ 
curred,  the  satellite  signals  the  others  that  it  is  joining  the  formation  and  the  vehicles 
reconfigure  in  a  3-satellites  formation. 

4.  The  cyclic  controller  continues  issuing  control  commands  in  each  satellite,  while  the 
collision  avoidance  runs  in  the  background  executing  path  corrections  in  case  of  any 
possible  collision  with  another  vehicle  is  detected. 
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6.3.5. 1  Test  5  (P273-3)  results 


This  test  was  successfully  completed  and  the  vehicles  performed  the  expected  behavior.  An 
error  in  the  instructions  to  the  crew  in  the  test  procedure  files  cause  an  initial  misplacement 
in  the  desired  position  of  satellite  1,  however,  this  misplacement  did  not  affect  the  overall 
development  of  the  test. 

The  plots  in  Figures  6-9  show  the  trajectories  of  the  satellites.  During  the  initialization 
maneuver,  satellite  3  had  to  move  from  the  negative  x  position  to  a  positive  0.4m  position. 
An  initial  small  correction  was  actually  executed  by  the  collision  avoidance  mechanism  during 
this  positioning  stage  as  noticed  in  figure.  The  trajectory  initially  described  by  satellite  3  in 
the  x  direction  is  due  to  the  above  mentioned  misplacement. 

Figure  6-10  show  the  time  history  of  the  states  for  each  vehicle.  It  can  be  noticed 
how  primary  (SPH1)  and  secondary  (SPH2)  satellites  start  a  circular  formation  until  SPH1 
detects  the  possible  collision  with  the  tertiary  and  activate  the  collision  avoidance  path 
correction.  The  trajectory  of  SPH1  deviates  from  the  circle;  SPH3  also  tried  to  move  out  of 
the  path.  Additionally,  the  SPH2  was  also  affected  by  the  path  correction  since  its  commands 
are  coupled  to  the  motion  of  the  other  satellites  in  the  formation.  Eventually  when  no  more 
collision  threats  are  detected  the  3-satellite  formation  continues  its  path  to  finally  achieve 
the  formation. 

6.3.6  Test  6:  Implementation  as  a  random  initialization  algorithm 

This  test  demonstrates  the  performance  of  an  algorithm  for  random  formation  initialization. 
This  test  builds  up  on  the  results  of  P273  Test  3,  by  using  the  same  algorithm  with  an 
addition  of  a  module  for  astronaut  input.  In  this  test,  the  astronaut  was  able  to  manually 
command,  when  and  which  satellite  joins  the  formation. 

After  the  initialization  maneuver,  the  satellites  reach  initial  positions  in  the  boundaries  of 
the  test  volume.  After  the  30  seconds  allowed  for  this  positioning,  the  astronaut  was  in  charge 


161 


Figure  6-9:  Experimental  results  from  Test  5:  Trajectories. 


of  indicating  each  satellite  to  join  the  formation  by  pressing  a  key  in  the  laptop.  Pressing 
the  ”  A”  key  commands  the  SPH1  to  join  the  formation,  pressing  the  ”S”  key  commands  the 
SPH2  to  join  the  formation,  and  pressing  the  ”D”  key  commands  the  third  satellite  to  join 
the  formation.  The  astronaut  was  free  to  select  in  which  order  and  when  to  press  the  key. 
After  the  three  satellites  had  been  commanded  to  join  the  formation  and  the  formation  is 
achieved,  the  test  ends. 

6.3.6. 1  Test  6  (P273-6)  results 

This  test  was  partially  successful.  In  general  the  tests  achieved  the  objective  and  the  perfor¬ 
mance  of  the  control  was  as  expected.  However,  one  of  the  satellites  showed  poor  performance 
on  the  initial  estimator  convergence,  due  to  this,  its  initial  positioning  was  flawed. 

The  satellites  joined  the  formation  as  commanded,  and  achieved  the  desired  configuration 
in  their  estimated  states,  with  the  SPH2  having  a  biased  estimation  of  its  state. 

Figures  6-12through  6-15  show  the  corresponding  trajectories  and  the  position  and  atti¬ 
tude  states  for  each  satellite.  Each  one  joined  the  formation  from  an  arbitrary  location  when 
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Figure  6-10:  Experimental  results  from  Test  5:  States  vs.  time. 
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Figure  6-11:  Experimental  results  from  Test  5:  Relative  states  SPH1  to  SPH3  vs.  time. 


randomly  commanded  by  the  astronaut.  The  time  when  each  satellite  joined  is  indicated  by 
the  black  arrow.  Even  though  the  test  is  not  considered  completely  successful  due  to  the 
divergence  of  the  estimator  in  the  SPH2,  the  actual  performance  of  the  algorithm  was  as 
expected. 

This  test  verified  the  modularity  and  interchangeability  properties  of  the  control  ap¬ 
proach,  while  maintaining  reduced  complexity  as  the  number  of  vehicles  is  increased. 


6.4  Performance  Analysis 

In  this  section  we  consider  an  analysis  of  the  ’steady  state’  performance  of  the  formation 
control  mechanism  by  considering  some  metrics  that  describe  the  efficiency  of  the  algorithms 
in  achieving  a  synchronized  rotating  formation.  The  analysis  is  based  on  steady  state  data 
extracted  from  the  tests  described  above  and  predated  tests,  performed  in  early  test  sessions. 

As  metrics  to  analyze  the  performance  of  the  system  we  consider  the  ratio  between  the 
theoretical  fuel  usage  and  the  actual  fuel  usage  for  a  given  maneuver  while  also  comparing 
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Figure  6-12:  Experimental  results  from  Test  6:  Trajectories. 
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Figure  6-13:  Experimental  results  from  Test  6:  SPHl  States  vs.  time. 
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Figure  6-14:  Experimental  results  from  Test  6:  SPH2  States  vs.  time. 
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Figure  6-15:  Experimental  results  from  Test  6:  SPH3  States  vs.  time. 


the  error  metric  to  symmetric  formation  e  =  Vrnx  where,  Vrn  =  L\  (8>  Rn/N  +  Lj  ®  R^/N  is  a 
projection  into  the  subspace  of  regular  polygons  as  presented  in  Chapter  4.  This  metric  of 
error  however  is  only  valid  for  3  or  more  satellites.  Two  satellites  will  always  be  in  a  ’perfect 
formation’  under  this  metric. 

The  theoretical  AV  is  calculated  as  an  integral  of  the  theoretical  acceleration  magnitude 
AF  =  Slj \\a\\2dt. 

Table  6.1  compares  the  fuel  performance  achieved  in  different  maneuvers  in  different  ISS 
test  sessions  and  under  different  architectures.  Figure  6-16  shows  the  maneuver  and  the 
error  performance. 

It  is  important  to  note  that  under  the  error  performance  as  defined  by  the  ’polygon 
symmetry’  metric  mentioned  above  is  valid  only  for  more  than  two  vehicles.  Under  this 
metric  the  cyclic  pursuit  approach  shows  for  all  cases  error  performance  better  than  the 
other  architectures  as  shown  in  fig.  6-16. 
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Test 

Control  Architecture 

Maneuver  Description 

AvV  ratl° 

P272.T4 

Relative  States  Central  LQR 

Circle  2-sat,  u  =  r  =  0.4m 

6.0 

P162.T2 

Individual  PID  tracker 

Circle  3-sat,  u  =  r  =  0.4m 

1.49 

P265.T2 

Individual  PID  tracker 

Spiral  2-sat,  ui  —  r  =  0.1  —  0.7 m 

1.47 

P264.T2 

Cyclic  pursuit  w/  ref.  vel. 

Spiral  2-sat,  uj  =  r*  =  0.35  — 0.5m 

1.30 

P264.T2 

Cyclic  pursuit  w/  ref.  vel. 

Circle  3-sat,  u  =  r  =  0.4m 

1.40 

P273.T6 

Cyclic  pursuit  w/  ref.  vel. 

Circle  3-sat,  u  =  r  =  0.4m 

1.40 

P273.T4 

Cyclic  pursuit  w/  ref.  vel. 

Circle  3-sat,  lj  —  ~,  r  =  0.4 

1.39 

P282.T2 

Cyclic  pursuit  Relative  Navi¬ 
gation 

Circle  2-sat,  u  =  ~,  r  =  0.5 

1.36 

Table  6.1:  Comparative  fuel  use  for  several  control  architectures 


Figure  6-16:  Error  in  symmetry  for  three  cases  in  table  6.1.  from  left  to  right  P162.T2, 
P273.T4,  P273.T6.  Cyclic  Pursuit  cases  are  the  two  on  the  right. 
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The  fuel  performance  presented  in  table  6.1  shows  experimental  results  agreeing  with  the 
expected  improvement  on  reducing  the  control  effort  by  using  the  cyclic  pursuit  architecture 
while  maintaining  the  symmetry  of  the  formation.  These  results  however,  should  not  be 
taken  as  direct  verification  of  this  improvement  effect  since  the  data  used  in  the  comparison 
was  not  specifically  designed  for  achieving  the  same  objective  and  the  vaxiability  in  the 
experiment  conditions  have  not  been  considered  in  the  analysis.  Nevertheless,  the  results  do 
show  that  for  the  formation  flight  experiments  flown  in  microgravity  environment,  the  cyclic 
pursuit  approach  has  lower  fuel  use  while  maintaining  similar  performance  in  maintaining  a 
symmetric  formation. 


6.5  Summary  and  Conclusions  of  the  Chapter 

This  chapter  presented  experimental  results  for  the  first  ever  implementation  of  decentralized 
formation  flight  in  space.  Several  experiments  were  performed  on  the  SPHERES  testbed 
aboard  the  International  Space  Station.  Such  experiments  demonstrate  the  validity  of  the 
algorithms  in  achieving  geometric  pattern  formation  control  in  relevant  hardware.  The 
applicability  in  multiple  scenarios  demonstrates  the  versatility  and  inherent  simplicity  of 
the  proposed  decentralized  approach.  Additionally,  the  analysis  of  the  fuel  performance  and 
error  as  compared  to  previously  implemented  approaches  agreed  with  the  expected  reduced 
control  effort  in  achieving  the  pattern  without  specifically  tracking  trajectory  fixed  points. 

The  performance  of  the  algorithms  as  a  formation  control  strategy  was  verified  while 
demonstrating  their  capabilities  to  accomplish  several  simulated  mission  scenarios  relevant 
for  a  fractionated  spacecraft  mission. 

In  the  joining  maneuver  test  (Test  2),  the  center  of  the  formation  an  uncontrolled  state. 
The  invariance  of  the  geometric  center  of  the  formation  is  noticeable  in  the  experimental 
results:  when  the  third  vehicle  joins  the  two- vehicle  formation  the  center  of  the  formation 
moves  to  include  the  effect  of  the  initial  position  of  the  third  vehicle.  This  effect  is  of  course 


169 


controllable  by  using  kg  >  0  as  described  in  remark  at  the  expense  of  control  effort  and 
knowledge  of  the  global  positioning. 

The  importance  of  a  nonlinear  extension  was  evident  from  initial  experimental  results. 
When  using  only  a  linear  approach,  the  discretization  effects  and  the  time  delays  caused  a 
divergent  behavior.  The  effect  was  compensated  by  adjusting  the  pursuit  angle  applying  the 
extension  as  mentioned  in  Section  3.2.4. 

The  addition  of  a  feedforward  term  by  upgrading  the  control  approach  to  eq.  3.32,  im¬ 
proved  the  performance  of  the  controller  by  achieving  a  more  precise  radial  control.  In  the 
initial  implementation,  the  equilibrium  value  of  the  dynamic  angle  a  was  achieved  at  a  radial 
distance  different  from  the  one  specified.  In  later  tests  when  the  feedforward  term  was  imple¬ 
mented,  the  radius  of  the  formation  was  much  more  precise  as  can  be  appreciate  in  figs.  6-3 
as  compared  to  6-8,  6-9.  The  precision  can  be  further  improved  by  implementing  and  integral 
control  approach  by  including  a  term:  a  =  tt/N —  k(\\xi+i  —  Xi\\  — p)  —  k  f  (\\xi+i  —  Xi\\\  — p)dt, 
dependent  on  the  accumulated  error.  The  theoretical  development  of  this  approach  is  how¬ 
ever,  out  of  the  scope  of  this  thesis.  Preliminary  simulations  demonstrate  it  as  a  valid 
approach  but  it  was  not  implemented  on  the  tests  and  is  left  as  a  possible  venue  for  future 
work. 

In  the  implementation  of  the  only  relative  measurements  controller,  based  only  on  theo¬ 
retical  results  the  z-motion  gains  were  setup  to  1.  Simulations  without  accounting  for  noise, 
disturbances  and  constrained  actuation  showed  good  convergence  performance.  However, 
under  the  actual  testing  conditions  on  hardware,  the  underperformance  of  the  control  in 
the  z-direction  became  evident  as  seen  in  the  data  plots  shown  below,  especially,  due  to  a 
constant  disturbance  in  the  +Z  direction  discernible  from  the  debug  data. 
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Chapter  7 


Decentralized  Control  in 


Electromagnetic  Formation  Flight 

7.1  Introduction 

In  this  chapter,  the  idea  of  decentralized  control  is  extended  to  the  case  of  Electromag¬ 
netic  Formation  Flight  (EMFF)  systems.  EMFF  is  a  very  innovative  concept  envisioned  for 
propellantless  spacecraft  formation.  However,  these  systems  have  very  particular  coupled  dy¬ 
namics  and  a  straightforward  implementation  of  decentralized  control  techniques  designed 
for  decoupled  systems  fails  to  address  their  strong  actuation  coupling. 

To  achieve  the  benefits  of  decentralization  in  this  type  of  system,  an  analysis  of  some 
ideas  for  decentralization  of  electromagnetic  formations  is  formally  presented  in  this  chapter. 

A  first  section  introduces  the  concept  of  electromagnetic  formation  flight  technology,  with 
some  emphasis  on  the  coupled  nature  of  the  actuation  commands.  Then,  the  approaches  to 
decentralization  are  presented.  In  summary,  several  techniques  that  can  achieve  control  of 
a  system  of  EMFF  satellites  in  a  decentralized  manner  are  studied  by  considering  two  main 
different  directions.  The  first  one  consists  on  decoupling  the  dynamics.  The  second  one 
addresses  the  problem  by  distributing  the  computation  and  the  need  for  a  central  computer. 
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The  general  approach  to  the  methods  presented  in  this  chapter  is  rather  heuristic  given 
the  difficulty  of  the  problem  but  some  specific  theoretical  results  are  discussed.  The  different 
proposed  ideas  are  implemented  in  simulation  to  compare  their  performance  to  a  centralized 
approach.  A  more  extensive  theoretical  analysis  of  each  one  of  them  is  left  out  of  the  scope 
of  the  present  work  and  is  suggested  as  a  direction  in  future  work. 

7.1.1  Electromagnetic  Formation  Flight 

The  Electromagnetic  Formation  Flight  (EMFF)  technology  has  been  recently  studied  and  is 
currently  being  developed  by  the  Space  Systems  Laboratory  at  MIT  in  collaboration  with 
Aurora  Flight  Science  (formerly  Payload  Systems).  Similar  approaches  have  been  indepen¬ 
dently  proposed  by  groups  at  the  University  of  Tokyo  and  the  Boeing  company.  The  principal 
advantage  of  EMFF  systems  is  the  independence  from  expendable  propellants.  This  can  be 
an  extremely  important  factor  for  long  duration  missions,  missions  that  require  extensive 
reconfiguration  maneuvering  or  missions  where  the  impingement  of  propellant  particles  can 
affect  the  system  performance. 

The  principle  of  operation  behind  EMFF  is  the  used  the  coupled  electromagnetic  forces 
and  torques  to  control  the  relative  position  of  a  group  of  vehicles  in  space.  The  mechanism 
used  to  create  the  electromagnetic  forces  between  vehicles  consists  of  a  set  of  orthogonal 
coils  that  generate  magnetic  fields  when  current  is  run  through  them. 

As  opposed  to  other  systems  proposed  for  propellantless  formation  flight,  like  flux  pinned 
[58]  or  coloumb  force  formation  flight  [85] ,  electromagnetic  formation  flight  achieves  control  of 
3N  translational  degrees  of  freedom,  including  shear  forces  which  are  not  achievable  through 
other  proposed  non  propellant  methods.  In  EMFF  any  force  and  torque  command  can  be 
readily  achieved  by  controlling  currents  running  through  individual  coils  on  each  vehicle. 

Different  architectures  for  the  coils  have  been  envisioned  and  studied.  In  one,  the  coils 
are  made  out  of  conventional  conductive  material.  Aluminum  has  been  identified  as  the  most 
competitive  non-superconductive  material  for  this  purpose  [82] .  In  this  case  pulsed  currents 
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used  as  a  mechanism  to  prevent  overheating  due  to  the  heating  effects  of  the  finite  resistance 
in  this  type  of  materials.  Theoretical  analysis  and  experimental  results  have  validated  the 
principle  of  operation  and  the  capabilities  to  achieve  net  forces  which  can  be  large  enough 
to  counteract  the  effects  of  J2  differential  terms  in  low  Earth  multi-satellite  systems. 

In  a  second  type  of  architecture,  High-Temperature  Superconducting  (HTS)  material  can 
be  used  to  build  the  coils.  In  this  case,  YBCO  or  BSSCO  composites  can  be  cooled  down 
below  a  critical  temperature,  achieving  superconducting  behavior.  In  this  case,  constant 
currents  of  higher  intensity  can  be  run  through  the  coils,  generating  much  larger  effective 
forces  between  vehicles. 


7. 1.1.1  Dynamics  of  EMFF  systems 

In  this  section,  we  discuss  the  relevant  dynamics  of  an  EMFF  system,  developed  in  previous 
literature.  [3,87] 

In  a  vehicle  i,  a  current  Ilx  is  generated  and  controlled  though  an  internal  computer  to 
run  through  the  coils.  In  a  circular  coil  aligned  with  the  body  2;- axis  in  vehicle  i  generates 
a  magnetic  field  which  can  be  approximated,  as  the  field  generated  by  a  magnetic  dipole 

ix  —  U  I  i.  x  Jd  ■ 

When  running  independent  currents  through  each  one  of  the  orthogonal  coils  in  one 
satellite,  a  composed  dipole  p;  =  f.iixx  +  Hiyy  +  pnzz  corresponding  to  the  vectorial  sum  of 
the  orthogonal  dipoles  in  satellite  i  is  generated  and  can  be  steered  in  any  direction  in  the  i 
body-frame.  This  allows  each  satellite  to  independently  command  its  dipole  in  any  direction 
and  under  an  agreement  on  a  global  coordinate  frame,  the  overall  formation  can  be  seen  as  a 
group  of  interacting  dipoles  that  can  be  pointed  on  any  direction.  Then,  the  magnetic  field 
generated  by  agent  i  is: 


Ik)  {  3  fJjj  '  T'ij  f  lj  \ 

4tt  \  r3-  ^  r3- ) 

\  13  / 


(7.1) 
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The  interaction  between  the  fields  of  the  dipoles  generate  forces  between  them.  The 


resultant  force  of  the  interaction  of  two  dipoles  ^i,^j  is  given  by: 


F 

F 

13 


3/ic  ( f-L’i.  '  f-^j  1  .  Ah  ■  dij  fij  ■  dij  ( Pi  '  dij)(nj  •  dij )  ^ 

“ir  W  '  15^  W*  “  i^r  ; 


dij 


(7.2) 

(7.3) 


and,  the  overall  force  of  a  formation  of  vehicles  i  e  {1,  . ,'V } ,  is  given  by: 


Ft  =  (7-4> 

where  Fj  is  the  force  on  vehicle  i,  Ftj  is  the  force  on  vehicle  i  due  to  vehicle  j,  p,o  is  the 
magnetic  permeability  constant  of  vacuum  and  is  the  vector  position  between  vehicle  i 
and  vehicle  j. 

These  set  of  equation  are  called  the  dipole  equations.  The  control  commands  are  the 
currents  run  through  each  one  of  the  coils  on  each  vehicle  which  directly  translate  into 
dipole  magnetic  fields  affecting  the  forces  of  the  overall  formation. 

The  special  coupling  in  a  system  of  EMFF  vehicles  is  evident  from  this  equation:  Indi¬ 
vidual  control  command  alters  the  forces  on  each  other  vehicle  in  the  formation,  therefore  a 
straightforward  extrapolation  of  distributed  control  mechanisms  proposed  for  other  type  of 
propulsion,  specifically  non-coupled  actuation,  is  not  feasible. 

Achieving  a  commanded  force  requires  coordination  with  at  least  one  other  vehicle,  since 
the  force  directly  depends  on  the  vectorial  value  of  another  dipole.  Additionally,  the  dipole 
enters  into  the  force  equation  as  a  multiplicative  parameter,  which  means  that  local  con¬ 
straints  in  its  magnitude  do  not  guarantee  global  constraints  in  its  disturbance  effect  on  the 
other  vehicles  in  the  formation.  These  coupling  effects  pose  an  important  challenge  to  the 
decentralization  of  EMFF. 
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For  the  closed  loop  control  approaches  in  the  existing  literature,  the  overall  formation 
state  information  is  gathered  in  a  central  computer,  the  set  of  dipole  equations  are  solved 
every  control  period  and  the  current  commands  issued  to  each  one  of  the  vehicles  in  the 
formation. 

In  this  chapter  of  the  thesis  we  discuss  and  compare  different  approaches  to  achieve  the 
objective  of  achieving  control  of  an  electromagnetic  formation  without  the  need  of  using  a 
central  computer  that  solves  the  set  of  equations  every  control  period. 


7.2  Token  Based  Decoupled  Maneuvering 

In  this  section  we  study  a  solution  to  the  EMFF  decentralization  problem  by  decoupling  the 
actuation  through  time  allocation. 

A  token  based  mechanisms  is  used  as  the  time  allocation  mechanism.  The  approach 
considers  the  solution  to  a  constrained  optimization  problem  such  that  only  one  subset  of 
the  vehicles  actuate  at  a  time.  It  is  a  token  based  approach,  because  only  vehicles  owning  a 
’token’  can  actuate  at  a  given  time.  The  token  sequence  is  calculated  as  part  of  an  overall 
optimization  problem. 

In  the  general  trajectory  optimization  problem,  a  centralized  solution  can  be  obtained, 
without  restricting  the  number  of  vehicles  that  can  actuate  at  a  time.  Open  loop  tracking  of 
the  input  time  history  should  achieve  the  final  configuration.  It  is  however  known  that  any 
small  disturbance,  and  especially  in  a  nonlinear  system  like  EMFF,  will  cause  divergence  from 
the  desired  final  state.  Therefore,  the  best  approach  is  a  close  loop  tracking  of  the  optimal 
state  time  history.  If  however,  the  solution  of  the  optimization  problem  is  obtained  under 
the  constraint  that  only  a  subset  of  vehicles  can  actuate  at  a  time,  a  natural  decentralization 
of  the  trajectory  tracking  problem  occurs.  Tracking  the  trajectories  would  not  require  an 
agreement  of  the  overall  set  of  vehicles  but  only  a  subset  of  them,  reducing  the  complexity 
of  the  tracking  problem. 
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Such  trajectory  optimization  problem  is  special  in  the  sense  that  it  has  specific  constraints 
on  the  number  of  vehicles  that  can  be  used  at  a  given  time  and  needs  to  be  approached  in  a 
special  manner.  This  problem  can  be  solved  considering  a  two-level  structured  optimization 
problem. 

In  a  lower  level  problem  a  set- wise  subproblem  is  to  be  solved,  considering  the  optimal 
dipole  selection  for  achieving  an  optimal  reconfiguration  maneuver  using  only  a  subset  of 
vehicles.  In  the  higher  level  problem,  the  sequence  of  vehicles  participating  at  each  allocated 
time  slot  is  considered. 

The  approach  to  solve  the  lower  level  trajectory  optimization  problem  was  implemented 
by  using  a  pseudo-spectral  method  approach,  where  the  states  and  controls  are  mapped 
into  a  parameter  discretization  based  on  Legendre  polynomials.  Optimal  reconfiguration 
maneuvers  using  this  approach,  have  been  studied  in  the  past  for  formations  with  several 
vehicles  [3]  for  deep  space  dynamics.  In  this  thesis,  these  results  are  extended  by  solv¬ 
ing  for  optimal  reconfiguration  maneuvers  considering  more  complex  dynamic  situations,  in 
particular,  Clohessy- Wiltshire  dynamics. 

A  solution  algorithm  for  the  higher  level  problem  was  implemented  using  a  Dynamic 
Programming  (DP)  approach,  solving  for  the  sequence  that  achieves  minimum  cost. 

The  overall  reconfiguration  problem,  considers  a  set  of  N  vehicles  on  initial  positions  x  = 
x(t0)  =  [xi(to)>  x2(to))  Xjv(io)]  which  we  are  interested  in  reconfiguring  to  final  positions 
x/  =  x(t/)  while  minimizing  some  cost  (time,  angular  momentum,  current  intensity  or  a 
combination  of  them).  A  general  case  with  dynamics  x  =  /(x)  +  U{  is  assumed. 

In  a  token  based  time  divided  decentralized  approach  like  the  one  proposed  in  this  section, 
the  vehicles  reach  the  final  positions  by  moving  in  a  sequence  Sopt  =  {5j,  S2,  . . . ,  5',v-a}, 
where  Si  is  the  set  of  active  vehicles  during  time  interval  [tu  ti+i). 

The  total  time  is  assumed  to  be  tf  — 10  =  ti,  and  at  each  interval  only  a  vehicles  can 
be  active,  (card(5'i)  =  a),  and  at  least  a  —  1  vehicles  reach  Xi(ti+i),  such  that  Xj(£y)  =  Xif. 

The  description  of  the  two  subproblems  is  specified  in  the  sections  below. 


176 


7.2.1  Lower  level  problem  solution 


The  lower  level  problem  consist  of  finding  the  optimal  reconfiguration  maneuver  for  vehicles 
i  6  S[k\,  where  S[k\  is  the  set  of  vehicles  active  at  interval  k. 

The  approach  presented  in  the  solutions  in  this  sections  uses  the  Legendre  pseudospectral 
decomposition  approach  developed  in  [3].  In  this  method  the  control  and  the  state  variables 
are  discretized  and  an  optimization  problem  tries  to  find  the  values  at  the  specific  dis¬ 
cretization  points  such  that  the  solution  minimizes  the  desired  cost  function.  Extending  this 
approach  we  consider  a  method  to  achieve  solutions  for  maneuvers  under  Clohessy-Wiltshire 
dynamics. 

The  reconfiguration  maneuver,  bringing  a  set  of  vehicles  with  initial  conditions  x°,  to  a 
formation  with  final  condition  x-f  can  be  written  as  the  continuous  optimization  problem  [3] : 


s(x) 

=  min  J(f,x, /x) 
Mb 

subject  to  : 

x  =  f(x,  fj.) 

(Dynamics) 

X 

o 

II 

o 

(Initial  state) 

‘-s 

II 

C+. 

(Final  State) 

|  hi  |  ^  t^rnax 

(Actuation  saturation) 

inf  dij{t)  >  Dmin  (Collision  avoidance) 

\hRWi(t)\  <  Hmax  (angular  momentum  constraint) 

(7.5) 


where  x  =  [pv],  p  being  the  position  and  v  being  the  velocity  defining  the  state  of 
the  overall  formation,  [j,(t)  is  the  control  variable  and  J(t,  x,  jj,)  is  a  cost  function  to  be 
minimized. 

When  using  the  pseudospectral  method,  the  unknown  state  and  control  trajectories  are 
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parametrized  by  coefficient  of  Legendre  polynomials: 


Nd 

p  =  5^p(*i)&(*)  (7-6) 

»= 0 
Nd 

u  =  ]Pii  {U)<t>i(t)  (7.7) 

i=0 

where  </>;(f)  are  degree  interpolating  basis  for  the  Legendre  polynomials.  The  optimization 
problem  is  then,  mapped  into  a  Nonlinear  Programming  Problem  as  a  function  of  the  coef¬ 
ficients  P  G  RNxNd+1,  U  G  RMxiVd+1  and  tf 


9  =  P™n/(*,P,v^)  (7.8) 

subject  to  : 

D2P  —  2  T°^  F  =  0  (Dynamics) 

V>0(Po,  v0,  ro)  =  0  (Initial  state) 

f  (pNd ,  vNd ,  Tf)  =  0  (Final  state) 

c0(p0,  v0,  ufc,  tk )  <0  VA:  G  {0, 1, ...,  Nd}  (Linear  constraints 

(e.g.  collision  avoid.,  saturation  )) 

^  T°^  WQ  —  Z  <  0  (Integral  constraints  (e.g.  angular  momentum)) 

where  D  G  M.NdXNd  is  a  differentiation  matrix,  P  G  (Nd  +  1)  x  n  is  a  matrix  with  columns 
Pi,  that  is,  each  column  of  P  represents  the  position  coefficients  at  each  discretization  point. 

F  G  RiV'i+1XT1  approximates  the  dynamic  vector  field  in  the  space  of  Ndh  order  polynomials, 
W  G  RNdX(Nd+i)  is  an  integration  matrix,  Q  G  R('/v,i+1^xl  approximates  the  constraint  inte¬ 
grands,  and  Z  G  K‘VdXl  is  a  given  matrix  of  the  constraint  value  at  each  discretization  point. 

A  more  detailed  description  of  this  definitions  is  found  in  [3] . 
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7. 2. 1.1  Results  of  the  low  level  optimization  problem 


The  results  presented  in  here  use  this  approach  to  solve  for  the  optimal  reconfiguration 
maneuvers  for  relevant  dynamic  cases.  The  solution  of  the  problem  was  implemented  using 
a  Sequential  Quadratic  Algorithm  (SQP)  in  MATLAB®  using  the  SNOPT  6.0  package 
routines. 

Figure  7-1  shows  a  surface  plot  of  the  the  optimal  cost  for  a  2-sat  reconfiguration  ma¬ 
neuver  under  Clohessy-Wiltshire  dynamics  and  some  examples  of  the  solutions  obtained. 

In  this  example  the  initial  relative  location  of  the  second  satellite  is  (1,0 )km  and  the 
maneuver  time  is  fixed  to  half  an  orbital  period.  The  surface  plot  is  a  function  of  the  desired 
final  position.  The  boundary  conditions  are  such  that  the  initial  and  final  state  of  both 
vehicles  are  closed  natural  orbits  (ellipses  with  the  appropriate  angular  period). 

7.2.2  Higher  level  problem  solution 

The  higher  level  subproblem  consists  on  defining  an  ordered  sequence  {S}k  =  { 5' [  1  ] ,  S’ [2], ....  5^/V]} 
of  agent  subsets  such  that  the  overall  cost  function  J  is  minimized. 

The  overall  cost  of  achieving  the  reconfiguration  maneuver  is  the  addition  of  the  cost 
for  each  individual  reconfiguration  maneuver.  Then,  the  overall  problem  can  be  written  as 
finding  Js *  such  that: 


Js *  =  minJs(2[0]) 
ses 

J5(x[0])  =  E  |^„(xn)  +  53^(x[/:],S,[fc],«;[fc])| 

l  fc= o  J 

where  n  =  N  —  p  is  the  number  of  reconfiguration  maneuver  to  achieve  the  final  desired 
state,  S[k\  =  {s,  s}  is  the  set  used  at  interval  [k],  s  is  one  of  the  agents  and  s  is  the  rest  of 
the  agents  in  a  subset  S,  and  is  cost  of  achieving  a  subset-wise  reconfiguration  maneuver, 
with  initial  state  x  such  that  agent  s,  achieves  its  desired  final  state  at  the  final  time. 
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Jmin  =74.7167,  0=3-1416 


Figure  7-1:  Optimal  minimum  current  two-vehicle  maneuvers  in  Clohessy- Wiltshire  dynam¬ 
ics 
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A  Dynamic  Programming  (DP)  approach  to  the  problem  can  be  used  by  defining  the 


optimization  problem  with  the  variables  as  described  in  table  7.1: 


State  variable  x[/c]  =  [xi  [£] ,  x2  [A;] ,  ...xjv[fe]] 
Control  variable  u [k]  =  Sk  €  Uk,  Uk(xk)  —  {s,  s}, 


Dynamics  x[fc  +  1]  =  f(x[k],  u[k],  w[/c]) 

Cost  function  J[k]  =  g(Sk,x[k])  ,  s.t. 
_ xs[T]  =  x{ _ 


x[k]  is  the  state  of  the  vehicles 
at  time  interval  [k] 

Sk  is  the  ordered  pair  active,  al¬ 
lowed  to  maneuver  during  inter¬ 
val  [k],  s  e  {1, 2, N} 
x  evolves  given  u[k]  and  a  ran¬ 
dom  disturbance  w[A;] 


Table  7.1:  Variable  descriptions  for  the  higher  level  DP  optimization  problem 


Then,  the  DP  approach  consists  on  solving  the  problem: 


j\k\ 
Jn(%n ) 


min  E{gk(x[k],u[k],w[k])  +  Jk+1(f{x[k],u[k],w[k}))}  (7.9) 

u[fc]et4 

9n(xn)  (7-10) 


Fig.  7-2  shows  the  a  reconfiguration  maneuver  where  only  2  vehicles  are  allowed  to  move 
at  a  given  time.  The  reconfiguration  sequence  can  be  compared  to  a  centralized  approach 
where  all  vehicles  can  actuate  at  the  same  time  in  Fig.  7-3.  The  dashed  lines  show  the 
interconnection  at  a  given  time. 


N 

1  v  spc 

card(S')  Optimal  Sequence 

CostAmps/'y 

Cost  Increase 

5 

2  ( 

[  (4,  5)  (2,  3)  (3,  5)  (5, 

1)  }  2.984  x  107 

18% 

5 

3  i 

[  (4,  5,  1)  (2,  3,  1)  } 

2.958  x  107 

17% 

5 

4  j 

[  2,  4,  5,  1)  (1,  3,  0,  0) 

}  2.658  x  107 

5% 

5 

5  \ 

!  (1,  2,  3,  4,  5)  (2,  3,  1) 

}  2.524  x  107 

- 

Table  7.2:  Increase  in  RMS  current  in  coils  as  the  number  of  vehicles  that  can  be  moved  at 
a  time  changes 
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Figure  7-2:  Optimal  reconfiguration  maneuver  -  Clohessy-Wiltshire  dynamics  only  two 
vehicles  actuate  at  the  same  time. 


N a  pc 

card(S') 

Optimal  Sequence 

Maneuver  times 

Total  Time 

5 

3 

{  (!>  3,  2)  (4, 

5.  2)  } 

41.8,61.8 

103.6 

5 

4 

{  (2,  3,  5,  1) 

(1,  4,  0,  0)  } 

34.1,41.2 

75.3 

5 

5 

{  (1,  2,  ,3,  4, 

5)  } 

37 

37 

Table  7.3:  Minimum  maneuver  time  as  the  number  of  vehicles  that  can  be  moved  at  a  time 
changes 
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Figure  7-3:  Optimal  reconfiguration  maneuver  -  Clohessy- Wiltshire  dynamics  only  two 
vehicles  actuate  at  the  same  time. 

7.3  Decoupled  Regulation  by  Resource  Allocation 

In  this  section  we  consider  a  method  for  decentralizing  EMFF,  based  on  the  ’allocation’ 
of  the  magnetic  interaction.  This  allocation  is  performed  in  an  analogous  manner  to  a 
communication  channel  allocation.  By  allocating  the  interaction,  the  approach  guarantees 
that  the  dynamics  are  coupled  only  among  the  set  of  vehicles  that  can  coordinate  their 
dipoles  through  local  information  sharing.  Two  possibilities  are  considered,  a  time  based 
division  and  a  frequency  based  division. 

7.3.1  Schedule  based  regulator 

A  method  to  achieve  time  division  consists  in  using  a  synchronization  mechanism,  based  on 
synchronized  clocks  on  each  vehicle  or  by  an  external  signal.  Additionally,  the  spacecraft 
will  require  an  external  agreement  or  an  intervehicle  consensus  mechanism  to  define  the 
time  schedule  for  each  set  of  vehicles.  The  definition  of  this  higher  level  time  agreement 
mechanisms  is  not  in  the  scope  of  this  work.  If  the  vehicles  have  access  to  a  global  signal 
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like  the  GPS  signal,  they  will  have  a  synchronization  resource  available. 

The  scheduling  mechanism  has  to  take  into  account  the  interconnection  topology.  A  set  of 
neighbors  that  are  active  have  to  be  able  to  communicate  during  the  actuation  period.  Once 
each  vehicle  has  knowledge  of  the  time  schedule  when  it  can  actuate  and  the  neighbors  it  is 
actuating  with,  the  solution  of  the  dipole  equation  needs  to  be  found  for  those  active  vehicles. 
A  reduced  order  set  of  dipole  equations  is  to  be  solved  for  the  members  of  the  subset,  in  a 
distributed  manner  as  discussed  in  a  later  section  or  by  one  of  them  and  communicated  to 
the  rest  of  group. 

Several  results  in  the  literature  have  addressed  the  effects  of  time  varying  topologies  and 
can  be  used  to  address  the  stability  of  the  mechanisms  presented  in  this  section  [72, 79]  for 
simple  dynamic  cases  which  could  be  extended  to  more  complex  dynamics.  Specifically,  the 
result  for  theory  of  consensus  regarding  convergence  under  switching  information  exchange 
topologies.  Necessary  conditions  for  convergence  for  consensus  based  control  laws  are  pre¬ 
sented  in  [79].  A  main  result  is  that  the  interconnection  topology  has  to  be  connected  over 
some  time  interval.  Its  extrapolation  to  more  general  dynamics  is  still  a  topic  of  research 
and  some  results  for  connected  topologies  have  been  described  in  more  recent  work  [72] . 

In  general,  for  fast  enough  switching  rates,  the  results  can  be  shown  to  approximate  the 
constant  interconnection  case  with  a  disturbance  that  depends  on  the  length  of  the  time 
intervals.  It  is  important  however,  to  consider  in  the  design  of  the  control  protocol  the 
fact  that  EMFF  forces  only  produce  internal  forces,  and  thus,  when  applying  the  desired 
forces  to  only  a  subset  of  the  full  formation  it  is  not  guaranteed  that  the  sum  of  the  desired 
forces  of  the  subset  is  zero.  This  situation  is  addressed  in  the  protocol  presented  in  the  next 
section  and  a  further  theoretical  analysis  of  the  effects  of  the  switching  period  is  discussed 
in  a  section  below. 
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7.3. 1.1  Results 


In  this  section  we  introduce  a  switching  protocol  to  decouple  the  dynamics  of  the  electro¬ 
magnetic  formation  through  time  division.  Simulations  show  the  protocol  implementability 
and  performance.  As  mentioned  in  the  introduction  to  the  approach,  the  idea  is  based  on 
periodic  switching  topologies,  in  a  way  that  over  a  full  cycle,  every  vehicle  has  been  ac¬ 
tive  at  least  for  one  period.  Without  loss  of  generality,  in  examples  below,  we  explore  the 
performance  of  an  approach  based  on  cyclic  sequencing. 

The  cyclic  sequencing  can  be  described  as  follows:  For  a  formation  with  vehicles  i  G 
N  =  {1,2, ...,  N},  the  active  set  of  vehicles  at  time  interval  tk,  S(tk )  =  {si,  s2,  sNs}, 
sn  G  N,sn  =  mod(sn,  N )  is  such  that  S(tk+1)  =  S(tk)  +  n0,  where  nQ  <  card(S')  =  Ns  is  an 
offset  such  that  at  each  switching  time  S(tk)  fl  S(tk  +  1)  /  0. 

A  control  period  is  the  time  interval  tc  for  which  the  force  command  is  constant.  A 
switching  period  tk  =  ndtc  is  the  time  interval  between  subset  switching.  A  switching  cycle, 
is  a  time  interval  over  which  the  topology  switching  repeats  itself,  specifically,  if  the  switching 
cycle  is  a  uniform  cyclic  protocol  Ts  =  Ntk. 

Since  at  each  switching  period,  the  sum  of  the  commanded  forces  for  the  subset  of  vehicles 
is  not  necessarily  zero,  at  least  one  of  the  vehicles  in  the  set  will  not  be  able  to  actuate  the 
commanded  force.  The  key  development  on  the  protocol  presented  in  this  section  consists 
of  considering  one  of  the  vehicles  in  the  subset  as  a  leader.  The  dipole  configuration  of  the 
subset  will  be  setup  such  that  each  vehicle  in  the  group  other  than  the  leader  will  set  up  its 
commanded  forces  as  per  control  law  and  the  leader  will  have  a  known  residual  force  which 
will  be  taken  into  account  as  the  subset  changes  and  the  leader  changes.  If  sum  of  forces  over 
the  whole  formation  maintains  the  constraint  that  the  sum  of  all  forces  is  zero,  the  residual 
force  over  a  cycle  through  the  graph  should  approximately  cancel  out. 

The  following  synchronous  control  protocol  with  homogeneous  switching  intervals  is  pro¬ 
posed  and  implemented  in  simulation  for  different  control  laws: 
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Sequential  Subsetwise  Control  Algorithm _ 

1.  Vehicles  in  set  S(tk )  =  {si,  s2,  ...,  sNs}  share  measurement  informa¬ 
tion  and  calculate  best  estimate  of  current  relative  states. 

2.  Desired  force  for  each  vehicle  in  the  set  is  calculated  as  per  control 
law  adding  any  residual  force  Fs  from  previous  control  periods. 

3.  The  set  solves  for  the  dipole  configuration,  either  in  a  locally  central¬ 
ized  way  or  in  a  distributed  way  as  described  in  Section  7.4.  Leader 
of  the  set,  vehicle  si,  sets  its  force  to: 

Fr  =  -  £  a 

i£S(tk)/si 

such  that 

£  a  =  o 

i£S(tk) 

and  stores  Fr  as  its  residual  force.  All  other  vehicles  in  the  set  have 
zero  residual  force. 

4.  If  t  >  ffc+i  a  new  set  of  vehicles  S(tk+ 1)  is  activated. 

5.  goto  1. _ 


7.3.2  Frequency  division 

In  a  frequency  divided  resource  allocation  strategy,  subsets  of  vehicles  can  act  simultaneously 
applying  currents  shaped  by  orthogonal  functions  on  each  different  subset.  The  forces  due 
to  magnetic  fields  from  different  subsets  average  to  zero  over  a  control  period,  thus  effec¬ 
tively  decoupling  the  actuation  between  different  subsets.  This  approach  is  inspired  by  the 
approach  presented  by  the  work  of  Kaneda  et  al.  [34],  where  the  electromagnetic  formation 
was  decoupled  from  constant  perturbations. 

Consider  for  example  the  case  of  sinusoidal  functions.  The  imparted  Av  on  each  vehicle 
over  a  period  of  time  is: 

Av2n  =  (1/m)  /  \ni\\nj\q(t)dt 
Jo 


where  q(t )  is  a  vector  that  depends  on  the  position  of  the  vehicles  and  the  direction  of  the 
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dipoles. 

If  the  dipole  magnitudes  on  the  vehicles  are  setup  to  be  sinusoidal  functions  ^  — 
Hiosin(uJit),  with  high  enough  frequency  ujt  so  that  q  can  be  considered  constant,  consider 
vehicle  i,  interacting  at  the  same  time  with  vehicles  j  and  k,  ujj  =  cjj,  uk  =  nu}i}  n  >  1,  n  G  Z: 

r2w 

Av2w  =  {l/m)\nio\\vjo\qij  \  siniuitfsintujtfdt  +  \/j,io\\vko\(iik  sin(uit)sin{ukt)dt 

Jo  Jo 

=  \lJio\\lJjo\q7j/2m  +  0,  for  nf  1 


Then,  vehicle  i  and  j  actuate  independently  of  the  actuation  of  vehicle  k  with  any  other 
vehicles  in  the  formation. 

In  general,  consider  the  formation  of  vehicles  i  E  N  —  {1,2, . . . ,  N},  consisting  of  subsets 
of  vehicles  Si,  shaping  their  control  inputs  over  a  period  tk  by  multiplication  by  a  function 
4>i{t)  such  that  lift)  =  Hiofft  —  tk  —  T),  for  t  €  [4,4  +  2 T). 

Make  each  <4,  a  function  of  a  set  of  shaping  functions  {(bft),  (f>j(t), . . . ,  oNf  (£)}  orthogonal 
over  the  interval  [— T,  T],  such  that: 

JT  (bif.dt  =  Sij  (7.11) 

Then,  the  impulse  during  a  control  period  between  a  pair  of  vehicles  with  dipole  /it  =  iMofi, 
and  /i,  =  iijo(f)j,  under  the  assumption  that  the  control  period  is  small  enough  such  that  q 
can  be  considered  constant,  will  be  given  by: 

rtk-\-2T 

Avik  =  (1/m)  j  \fJio\ ll-Ljolqijfiifjdt 

J  tk 

=  (l/m)  \jJ>io\ 


Then,  vehicles  sharing  the  same  shaping  frequency  &  will  interact  between  them,  but 
not  vehicles  with  shaping  functions  4>j.  Then,  the  size  of  the  dipole  equation  reduces  to  the 
size  of  the  subset  5/  with  dipole  shaping  (pi,  and  the  interactions  with  other  vehicles  can  be 
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disregarded. 


Interconnections  between  different  subsets  is  achieved  by  ’shared’  members,  which  coor¬ 
dinate  their  dipole  configuration  with  different  subsets  and  apply  a  superposition  of  dipoles, 
i.e  the  vectorial  sum  of  its  dipole  corresponding  for  each  subset.  Corresponding  orthogonal 
sets  will  cancel  out  and  the  ’shared’  vehicle  will  create  forces  between  different  subsets. 

As  mentioned  before,  any  set  of  orthogonal  functions  over  a  bounded  set  can  be  used  as 
shaping  functions.  For  example,  Legendre  polynomials  are  orthogonal  over  the  set  [—1,1] 
and  any  set  of  polynomials  can  be  used  to  shape  the  currents  over  a  period.  An  advantage 
of  using  a  polynomial  function  is  the  lower  frequency  content  of  the  first  nth  base  functions, 
however,  the  lack  of  periodicity  implies  that  the  final  value  of  the  current  at  one  period  does 
not  match  the  initial  value  of  the  current  (and  slope)  at  the  end  of  that  period.  There  are 
however,  orthogonal  sets  of  functions  that  could  be  more  fitted  for  an  specific  situation. 

If  the  limitation  of  the  system  is  given  by  the  maximum  current  that  can  be  achieved  on 
a  coil  (equivalently  a  maximum  dipole  magnitude),  other  type  of  orthogonal  functions  can 
improve  the  performance.  Consider  the  Walsh  functions: 


tk(t) 

=  \ni,sgn(sin(ujit)) 

Vj(t) 

=  \fij(t)\rijsgn(sm(u)jt )) 

A.v 

—  ( 1  jvfl)  |  Hio  1 1  fljo  I  Qij  1 

Jo 

sgn  (sin  (a;*  t) )  sgn  (sin  (ujj  t) )  dt 

(1  /iTl) \fJio\  \/Jjo\Qij 

if  ujj  =  u>i 

0 

if  u>j  =  2nuii,n  6  Z 

The  plots  in  7-4  show  the  basic  principle  behind  the  proposed  approach. 
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Figure  7-4:  .  Basic  results  showing  the  principle  of  operation  of  the  implementation  of 
decentralization  by  resource  division 


189 


7.3.3  Resource  allocation:  Simulation  results 


Two  benchmark  case  scenarios  are  considered  to  illustrate  the  performance  using  this  ap¬ 
proach.  In  one,  a  formation  of  vehicles  achieving  a  rotating  circular  formation,  where  we 
study  the  performance  as  the  a  steady  state  response  for  a  nonzero  required  output  force, 
and  two,  a  transient  scenario  where  we  study  the  convergence  to  formation  from  the  same 
arbitrary  initial  perturbed  state. 

The  simulations  in  a  preliminary  way  the  viability  of  this  methods.  In  the  case  in  fig. 
7-5,  the  formation  achieves  a  regular  polygon  from  a  random  disturbed  position  and  the 
control  currents  are  shown  for  each  case.  The  input  magnitudes  are  shown  as  d2/r2/,  which 
indicate  the  required  currents  to  achieve  the  equivalent  (far-field)  forces  normalized  for  a  1 
meter  formation  with  coils  1  meter  in  radius.  Therefore,  the  currents  in  the  results  scale 
with  the  term  r2/d 2  where  d  is  the  radius  of  the  coil  and  r  is  the  distance  between  vehicles. 

As  it  is  to  expect,  as  the  number  of  active  vehicles  decreases  the  coil  currents  required  to 
achieve  the  forces  are  larger.  The  coils  are  thus,  saturated  for  a  longer  time.  An  appropriate 
selection  of  the  control  gains  can  assure  in  any  case  preventing  saturation  while  making  the 
most  of  the  maximum  currents  of  the  system.  The  simulations  are  meant  to  show  how  the 
approach  is  valid  despite  the  reduction  in  control  authority. 

In  a  second  case  we  compare  the  currents,  required  to  maintain  a  rotating  formation 
under  double  integrator  dynamics  using  the  cyclic  pursuit  approach,  as  a  way  to  integrate 
the  results  in  previous  chapter  to  the  current  approach.  The  results  are  shown  in  fig  7-6 

On  the  other  hand  we  illustrate  the  approach  using  the  frequency  division  based  approach 
in  the  results  presented  in  figures  7-7,  7-8.  The  results  illustrate  how,  the  control  objective 
can  be  achieved,  at  the  expense  of  larger  required  currents.  Since  larger  currents  are  required 
to  achieve  the  same  forces,  the  control  authority  of  the  actuation  system  is  reduced. 
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8  vehicle  formation  -  Settling  performance 
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Figure  7-5:  Time  Division  allocation  -  Disturbance  rejection  transient 
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Input  vs  t 


Figure  7-6:  Currents  in  coils  Time  Division  for  different  number  of  vehicles  actuating  at  a 
time  -  Bottom:  Steady  State  Cyclic  Pursuit  (2  active  vehicles) 
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Figure  7-7:  Frequency  Division  allocation  -  Disturbance  rejection  transient.  The  z-input  is 
zoomed  into  the  first  25  seconds 
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Figure  7-8:  Frequency  Division  allocation  -  Steady  State  Cyclic  Pursuit.  The  x-input  is 
zoomed  into  the  first  25  seconds 
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7.4  Distributed  Computation  of  the  Solution  to  the 


Dipole  Equation 


In  this  section  we  explore  a  different  method  to  achieve  decentralization  of  EMFF  systems 
which  addresses  the  objective  by  solving  the  dipole  equation  (eq.  7.2)  in  a  distributed 
manner.  In  this  sense,  the  method  achieves  the  objective  of  defining  the  control  commands 
/x,  i.e.  the  dipoles  on  each  vehicle,  without  recurring  to  a  centralized  computing  unit  and 
subsequent  communication  load  to  issue  the  commands  to  each  vehicle  in  the  formation  as 
proposed  in  previous  approaches  [3]. 

In  the  proposed  technique,  the  solution  is  obtained  by  sharing  relative  position  knowledge 
and  the  solution  of  a  local  optimization  problem.  A  first  approach  to  applying  this  technique 
does  not  necessarily  imply  the  desired  characteristics  of  decentralization  at  its  best,  since  it 
would  still  require  an  interconnected  network  to  share  states  and  local  optimization  solution 
results.  However,  other  important  characteristics  of  a  decentralized  system  are  achieved  like 
deployment  independence,  robustness  to  individual  failures,  homogeneity  and  repeatability, 
and  more  importantly  it  does  not  require  a  powerful  central  unit  solving  the  nonlinear  dipole 
equation  at  each  control  step. 


7.4.1  Theoretical  description 

The  approach  to  a  distributed  solution,  considers  a  distributed  protocol  for  solving  a  global 
optimization  objective  that  minimizes  the  overall  formation  error  while  locally  solving  an 
optimization  problem.  Consider  the  dipole  equation  7.2  that  defines  the  control  commands 
to  achieve  the  commanded  forces: 
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The  electromagnetic  force  for  a  pair  of  vehicles  i,  j  is  a  bilinear  equation  on  the  inputs 
/ij,  jij  which  can  be  written  as: 


Fii 


Md5 


rfij  ■  hj  +  Ah  ■  djj  +  (/  -  5^  dJJ-) 

aij  ' 


/ij 


(712) 


and  then,  the  overall  system  of  equations  can  be  written  as: 
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where  i  =  N}/i  is  the  set  of  vehicles  in  the  formation  except  i,  and  /ij,  the  set  of 
corresponding  dipoles. 
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For  a  given  set  /q,  the  dipole  equation  can  be  written  as: 


F  =  M(/q,  x)fii  +  V (m,  x)  (7.13) 

where  the  term  M (m,  x)/q  describe  the  forces  caused  on  each  vehicle  by  dipole  i,  and  V (/q,  x) 
the  forces  caused  on  each  vehicle  by  vehicles  other  that  i. 

The  proposed  protocol  makes  use  of  this  structure  and  considers  solving  the  problem 
through  a  sequence  of  steps  in  which  each  vehicle  minimizes  a  cost  function  by  sharing  the 
result  of  solving  the  local  problem: 


Hi  =  arg  min 

Vi 

||Frf(x)  -F||l 

(7.14) 

s.t. 

M(pj,  x)/q  =  (F  -  V(/Xi,x)) 

(7.15) 

h(ni)  <  0 

(7.16) 

where  F(x)  is  the  control  command  known  by  each  vehicle.  Notice  that  to  solve  this  problem, 
agent  i  requires  x,  the  state  information  of  the  formation  (more  specifically,  only  the  relative 
states)  and  fih  the  value  of  the  dipole  solution  for  the  other  vehicles  in  the  formation.  By 
an  iterative  process,  where  p*  is  shared  through  a  connected  network,  the  convergence  to  a 
stationary  solution  is  guaranteed  if  h{in)  define  a  convex  subspace.  The  analysis  is  presented 
in  the  next  section. 

7.4.2  Convergence  analysis 

Consider  the  following  synchronous  protocol  following  a  periodic  sequence  {1,  2, ..,  N,  1,  2, ..}: 

The  analysis  of  the  convergence  properties  of  this  protocol  are  based  on  the  fact  that  the 
overall  algorithm  can  be  casted  as  a  gradient  method  with  gradient  related  descent  direction. 
Notice  that  the  agent  do  not  update  their  dipole  values  until  the  error  in  the  actuated  force 
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Distributed  Control  of  EMFF  via  distributed  solution  of  dipoles 

0.  Vehicle  i  receives  information  from  the  network:  current  state  esti¬ 
mate  x  and  dipole  values  p. 

1.  Solves  optimization  problem  7.14, 

2.  If  ||Fd(x)  -  F\\  <  emin||Fd||  or  dt  >  Tmax  set  own  dipole  to  p  =  p*. 

3.  Communicate  state  knowledge  and  updated  dipole  value  to  the  net¬ 
work. 

4.  Wait  until  next  cycle. _ 

Table  7.4:  Sequential  Distributed  Dipole  Solution 

is  less  than  a  minimum  value  emin||Fd||,  or  the  maximum  allocated  time  Trnax  to  converge  to 
a  solution  has  been  reached. 

Consider  a  following  general  optimization  problem: 


min  f(x) 

X 

s.t.x  E  X 

A  descent  method  is  defined  such  that  xk+1  —  xk  +  akdk,  where  dk  and  a  are  selected  to 
eventually  reach  a  minimum  of  the  function  f(x) 

Consider  the  following  definition  in  [11] 

Definition  7.4.1  A  direction  sequence  {dk}  is  gradient  related  if  for  any  subsequence  {xk}keic 
that  converges  to  a  non- stationary  point,  the  corresponding  subsequence  {dk}keic  is  bounded 
and  satisfies: 


lim  sup  Vxf(x.)'dk  <  0 
k-^-ookeK. 


and 


Definition  7.4.2  A  gradient  method  with  minimization  rule  updates  ak  is  such  that  xk  + 
akdk  <xk  +  /3dk,  p  €  R. 


198 


Proposition  7.4.3  Consider  the  global  optimization  problem: 


minH-Fi-FMII  (7.17) 

For  F,i  constant,  in  the  overall  algorithm  in  protocol  7.4,  p  is  updated  as  a  gradient 
method  with  minimization  rule  updates  and  with  gradient  related  descent.  When  including 
constraints  h(x)  <  0,  the  algorithm  is  a  gradient  feasible  direction  method  with  minimization 
rule  and  gradient  related  direction  sequence. 

Proof:  The  algorithm  in  protocol  7.4  can  be  shown  to  be  an  implementation  of  a 
gradient  method  with  gradient  related  direction  and  ak  selected  by  minimization  rule.  The 
proof  that  a  gradient  descent  method  with  feasible  gradient  related  direction  converges  to  a 
stationary  point  is  presented  in  proposition  2.2.1  in  [11]. 

The  gradient  of  /(x)  in  given  by: 

V*/(x)  =  2  ((MtoJ/Z!  +  V(/ii)  -  F)'M(pi)  (M(p2)p2  +  V(p2)  -  F)'M(^)  •  •  -)(7-18) 
dk  £  M3iV  is  zero  for  {i},  then: 

V,/(x)'4  =  +  V(w)  -  F)'M(WK  (7.19) 

At  every  iteration  step,  if  a  minimum  to  the  local  problem  is  found,  such  that  /q*  <  pi} 
the  global  variable  p  is  updated  such  that  pk+1  =  p  +  akdk ,  with  dk  is  a  vector  with  zeros 
in  the  components  not  corresponding  to  agent  i.  Otherwise,  if  a  minimum  p*  <  pi  is  not 
found,  p  is  not  updated  and  the  iteration  corresponds  to  another  vehicle  in  S.  Thus,  not 
necessarily  at  each  iteration  of  the  protocol,  there  is  an  update. 

If  a  minimum  to  the  local  problem  the  control  variable  p  is  found,  p  is  updated  as  p,  =  p* 
otherwise  it  is  not  updated.  Then,  the  update  sequence  is  updated  at  least  once  every  cycle. 
As  the  protocol  progresses  over  S,  p  is  updated  as  p  =  p.  ■ 
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Proposition  7.4.4  If  a  stationary  value  has  not  been  reached,  at  least  lupdate  occurs  over 
a  cycle  over  S. 

Proof:  Assume  that  a  stationary  value  has  not  been  reached,  and  no  update  occurred 
over  a  cycle,  in  the  next  cycle,  all  the  values  of  p,  are  the  same,  which  means  there  will  not 
be  further  updates,  and  a  stationary  point  has  been  reached.  ■ 

A  straightforward  observation  from  the  above  proposition  is  a  lower  bound  in  the  con¬ 
vergence  of  the  algorithm. 

Corollary  7.4.5  The  convergence  rate  over  iterations  for  the  distributed  protocol  7-4  is 
lower  bounded  by  ~r,  where  r  is  the  convergence  rate  of  a  gradient  based  with  minimiza¬ 
tion  rule  and  gradient  related  direction  sequence  for  the  global  problem. 

Consider  for  example,  that  the  set  h{pf)  is  given  by  the  constraints  in  the  maximum 
current  that  can  be  run  through  the  coils,  then  the  set  C  is  a  convex  set. 

7.4.3  Closed  loop  convergence 

The  relationship  between  state  update,  dipole  update  and  distributed  optimization  step  rate 
in  protocol  7.4,  are  parameters  that  affect  the  behavior  of  the  system. 

When  the  information  sharing  rate  is  fast  enough  compared  to  the  dynamics  of  the  overall 
system,  the  convergence  problem  can  be  approximated  to  the  static  case  where  the  desired 
force  Fd(x)  is  basically  constant  while  the  algorithm  converges.  However,  as  the  data  sharing 
rate  is  reduced  to  the  point  that  it  is  comparable  to  the  dynamics  time  constant,  a  more 
complex  dynamic  situation  has  to  be  addressed.  In  this  case  the  overall  objective  to  be 
addressed  is  the  stability  of  the  formation  error  under  the  dynamics: 

x+  =  f(x,  Fd  +  d) 
d  =  min (F(/j,,x)  -  Fd(x)) 

IM 

s.t.  h(p)  <  0 
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Initial  simulations  show  that  including  this  algorithm  in  a  control  loop  can  work  to 
achieve  stable  control  to  a  fixed  point  or  to  follow  trajectories,  but  the  theory  has  to  be 
further  researched  to  understand  under  which  conditions  this  approach  would  work  and  its 
usefulness  compared  to  a  centralized  approach.  Figure  7-9  shows  the  results  of  a  simulation 
where  the  forces  are  calculated  to  follow  circular  trajectories  using  a  PD  controller  and  the 
forces  are  setup  by  the  distributed  calculation  of  the  dipoles  as  suggested  in  this  section. 
The  vehicles  follow  a  circular  trajectory  setting  up  the  dipoles  in  a  distributed  manner.  The 
bottom  plot  shows  the  dipole  for  one  of  the  vehicles 
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Figure  7-9:  Figure  showing  a  group  of  vehicles  following  a  circular  trajectory  setting  up  the 
dipoles  in  a  distributed  manner. 
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7.5  Summary  and  Conclusion  of  the  Chapter 


Control  algorithms  that  require  a  centralized  solution  of  the  dipole  equation  could  be  unfeasi¬ 
ble  due  to  limitations  in  the  computation  power  or  communication  capabilities.  The  methods 
discussed  in  this  section  present  an  alternative,  which  can  be  of  major  importance  in  the 
implementation  of  formations  with  large  number  of  electromagnetic  propelled  vehicles  by 
allowing  the  implementation  of  control  algorithms  that  do  not  require  a  central  coordinating 
unit  calculating,  allocating  and  communicating  the  formation  control  commands. 

It  is  important  however,  to  consider  the  limitations  and  practical  considerations  when 
implementing  the  proposed  mechanisms.  In  the  case  of  time  divided  control,  one  of  the 
assumptions  is  that  the  control  cycles  have  to  be  fast  enough  to  reduce  the  effects  of  the 
time  divided  actuation.  This  could  imply  requirements  for  the  control  frequency  to  be 
higher  than  what  it  would  be  for  a  centralized  calculation  and  thus  increasing  the  number  of 
computations  per  second  and  reducing  one  of  the  advantages  of  decentralization.  However,  it 
is  to  be  noticed  that  the  solution  of  the  dipole  equation  is  a  nonlinear  optimization  problem 
with  exponentially  increasing  complexity  as  the  number  of  dipoles  increases.  The  increase 
in  the  number  of  cycles  per  second  to  achieve  the  time  divided  control  approach  increase 
required  to  achieve  similar  performance  is  sublinear.  Additionally,  there  is  a  limit  in  the 
number  of  operations  per  cycle  that  can  be  achieved  by  a  computing  unit,  and  the  power 
requirements  and  cost  of  computation  translated  also  escalates  exponentially. 

The  advantage  of  the  token  time  divided  maneuvering  as  presented  in  this  chapter  is 
that  it  derives  feasible  optimal  reconfiguration  maneuvers  for  a  problem  with  a  constraint  in 
the  number  of  active  vehicles,  however  the  implementation  may  require  another  propulsion 
system  that  maintains  control  of  the  unactuated  vehicles,  a  sequential  maneuvering  that 
achieves  the  final  objective  in  stages  and  reduce  the  inactivity  period  for  the  vehicles 

For  the  frequency  division,  the  maximum  number  of  different  orthogonal  sets  is  driven  by 
the  properties  of  the  mechanism  to  generate  the  shaping  functions,  specifically,  the  frequency 
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content  of  the  shaping  function  and  the  accuracy  within  which  the  clocks  on  each  vehicle 
can  be  synchronized. 

The  frequency  division  control  approach  could  be  combined  with  the  time  division  ap¬ 
proach  in  a  hybrid  mechanism  mentioned  in  the  previous  section  to  achieve  even  better 
performance.  In  such  a  case,  up  to  Nf  sets  of  vehicles  could  be  active  at  the  same  time 
without  interfering  with  each  other,  where  Nf  is  the  number  of  available  shaping  orthogonal 
functions. 

The  distributed  solution  to  the  dipole  equation  presents  also  a  valid  alternative  that 
can  reduce  the  computational  burden  and  scale  down  the  computational  requirements  of 
EMFF  formations  with  a  large  number  of  vehicles.  This  solution  however  requires  continuous 
communication  to  distribute  the  information  regarding  the  dipole  configuration  of  all  the 
vehicles  in  the  formation. 
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Chapter  8 


Conclusions  and  Final  Remarks 

8.1  Thesis  Summary  and  Conclusions 

A  new  approach  to  formation  flight  control  has  been  proposed  in  this  thesis.  In  this  approach 
the  formation  globally  converges  to  patterns  defined  by  constraints  of  the  desired  state 
and  not  to  (time  varying)  trajectory  fixed  points.  Additionally,  the  innovative  methods 
introduced  to  analyze  distributed  control  laws  opened  up  a  new  avenue  for  research  to  address 
more  efficient  and  stable  controllers. 

In  a  first  part,  the  cyclic  pursuit  approach  that  had  previously  been  studied  in  the  lit¬ 
erature  as  an  algorithm  to  achieve  circles  and  log-spiral  patterns  was  extended  by  deriving 
a  full  linear  eigendecomposition  analysis  of  the  three-dimensional  case.  The  eigendecompo- 
sition  analysis  lead  to  the  derivation  of  control  approaches  more  relevant  to  the  dynamics 
of  spacecraft  formations.  Extensions  addressing  robustness  and  convergence  to  other  type 
of  trajectories  were  developed  to  address  controllers  useful  for  near-earth  and  deep  space 
formation  flight  missions. 

The  initially  introduced  formation  acquisition  approach  was  then  extended  by  considering 
it  as  a  manifold  convergence  problem  and  using  the  tools  of  contraction  theory  to  perform 
an  analysis  of  its  performance.  The  analysis  in  the  context  of  the  partial  contraction  the- 
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ory  leads  to  a  more  general  understanding  of  the  problem  and  allows  the  generalization 
to  achieve  results  for  nonlinear  and  time  varying  systems  otherwise  unachievable  by  the 
eigendecomposition  method. 

The  contraction  theory  approach  to  the  analysis  of  distributed  controllers  opened  new 
avenues  for  research.  First,  it  demonstrates  an  approach  that  determines  global  stability  in 
terms  of  the  negative  definiteness  of  a  matrix,  which  for  the  case  of  distributed  controllers 
might  seem  a  more  convenient  approach  than  Lyapunov  methods  where  the  stability  is 
defined  by  demonstrating  the  negativeness  of  a  function.  The  general  notion  of  convergence 
is  reshaped  to  the  more  general  notion  of  manifolds  (or  subspaces)  which  defines  a  new 
dimension  to  the  widely  studied  consensus  problem. 

The  experimental  results  in  a  relevant  testbed  under  microgravity  conditions  demon¬ 
strated  that  the  implementation  is  feasible  in  the  context  of  spacecraft  formation  control. 
Specifically,  the  successful  results  are  partially  attributed  to  the  decentralized  nature  of  the 
approach  since  the  achievement  of  the  desired  global  behavior  emerges  from  appropriately 
verifying  the  local  behavior  of  the  vehicles. 

8.2  Contributions 

The  main  contributions  of  this  thesis  are: 

1.  Developed  a  new  approach  to  decentralized  spacecraft  formation  control  inspired  by 
the  cyclic  pursuit  algorithm.  It  can  be  more  efficient  in  terms  of  control  effort  by  not 
tracking  trajectories  but  by  converging  to  a  specified  manifold.  The  approach  achieves 
improved  properties  with  respect  to  the  most  common  approaches,  namely: 

•  Reduced  control  effort  by  not  tracking  irrelevant  degrees  of  freedom. 

•  Reduced  need  for  coordination,  i.e  does  not  need  to  agree  on  relative  trajectories. 

•  Leader(s)  can  control  free  degrees  freedom  of  the  overall  formation. 
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2.  Addressed  the  robustness  issues  of  classic  cyclic  pursuit  by  introducing  a  nonlinear 
extension  to  the  control  law  that  achieves  equilibrium  at  a  splay-state  formation  of 
determined  radius  and  a  corresponding  theoretical  stability  result. 

3.  Devised  a  transformation  scheme  that  allows  for  the  design  of  distributed  controllers 
that  converge  to  very  general  types  of  synchronized  trajectories. 

4.  Developed  decentralized  control  laws  based  on  the  cyclic  pursuit  approach  for  LEO 
formation  flight  that  globally  converge  to  near  natural  relative  trajectories.  Theo¬ 
retical  results  include  a  full  eigendecomposition  of  the  dynamics  showing  the  global 
convergence  as  well  as  simulation  results  showing  its  implementation  accounting  for  J2 
effects. 

5.  Formulated  decentralized  control  laws  for  second  order  systems  that  require  only  rel¬ 
ative  information  to  converge  to  different  geometric  patterns  and  can  be  of  impor¬ 
tance  for  formation  flight  in  deep  space  missions  without  an  accurate  global  reference 
frame.  The  patterns  of  convergence  include  circular  formations,  ellipse,  logarithmic, 
archimedean  spirals  and  polygons. 

6.  Introduced  an  analytic  approach  based  on  contraction  theory  that  allows  for  a  wide 
range  of  global  convergence  results  for  nonlinear  controllers  and  complex  configura¬ 
tions  based  on  combinations  of  cyclic  algorithms.  The  wide  extent  of  the  approach  is 
exemplified  by  obtaining  several  important  results: 

(a)  Proofs  of  global  convergence  to  regular  formations  based  general  on  cyclic  inter¬ 
connections. 

(b)  Global  convergence  results  for  distributed  controllers  that  converge  to  regular 
formations  of  specified  size. 

(c)  Extensions  of  the  contraction  theory  theorems  to  allow  for  proofs  of  convergence 
to  time  varying  manifolds. 
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(d)  Corollaries  that  allow  for  proofs  of  global  convergence  to  formations  based  on  any 
number  of  interconnected  subformations. 

(e)  Proof  of  convergence  to  formations  of  specified  size  through  a  leader. 

(f)  Derivation  of  sufficient  conditions  for  global  convergence  to  surrounding  a  target 
using  a  cyclic  control  approach  under  general  tracking  functions. 

7.  Implemented  hardware  tests  and  obtained  experimental  results  that  validate  the  char¬ 
acteristics  of  the  approach,  namely:  no  need  of  central  coordination,  extensible  to  any 
number  of  vehicles,  reduced  control  effort  and  simplicity  of  implementation  for  several 
formation  flight  scenarios. 

8.2.1  Secondary  contributions 

Additionally,  the  thesis  added  to  the  field  along  with  other  contributions  that  include: 

1.  An  investigation  that  compares  different  formation  control  architectures  to  a  decentral¬ 
ized  control  approach  where  the  control  is  not  based  on  tracking  relative  trajectories. 

2.  A  preliminary  study  of  the  solution  to  EMFF  reconfiguration  maneuvers  with  a  reduced 
interconnection  complexity  by  solving  for  the  optimal  maneuvers  that  only  use  a  subset 
of  vehicles  at  a  time. 

3.  The  development  and  a  preliminary  comparison  of  several  methods  to  achieve  decen¬ 
tralized  control  of  EMFF  by  decoupling  the  dynamics. 

4.  A  protocol  to  decentralizing  EMFF  by  distributing  the  solution  of  the  dipole  equation. 

8.3  Future  Work 

There  are  several  points  that  can  be  addressed  as  a  continuation  of  this  work  and  new  avenues 

for  future  research  that  were  opened  by  the  developments  of  this  thesis. 
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As  a  first  direction,  having  demonstrated  that  the  convergence  to  geometric  patterns  is 
achievable  under  more  general  cyclic  interconnections,  a  new  direction  should  consider  the 
design  of  more  robust  control  approaches  that  can  use  informations  of  neighbors  interchange¬ 
ably,  reducing  the  constraint  of  a  cyclic  interconnection.  At  first  glance  this  seems  like  a 
straightforward  extension  but  it  may  require  developing  some  machinery  to  achieve  formal 
proofs  that  verify  the  convergence  properties. 

In  this  work,  the  attitude  control  was  left  out  of  the  scope  other  than  a  basic  development 
for  the  experimental  setup.  It  can  be  convenient  however  to  define  controllers  that  combine 
measurements  in  the  local  body  reference  frame  of  the  spacecraft  which  could  achieve  a 
more  precise  control  performance  in  cases  where  measurements  are  dependent  on  the  relative 
orientation  of  sensor  and  target. 

In  Section  3.4,  it  was  shown  how  a  ’similarity’  mapping  scheme  can  be  used  to  achieve 
convergence  to  complex  trajectories.  Converging  to  elliptical  trajectories  was  shown  to  be 
useful  for  a  specific  application,  namely  closed  natural  relative  trajectories  for  near  circular 
orbits.  However,  closed  natural  relative  trajectories  for  orbits  with  increasing  eccentricity 
are  different  from  ellipses.  A  parallel  approach,  using  nonlinear  similarity  transformations 
can  be  useful  for  converging  to  such  relative  trajectories.  Additionally,  applications  in  other 
fields  can  deem  useful  applications  for  convergence  to  formations  with  very  specific  geometric 
patterns. 

A  whole  new  avenue  of  research  has  been  opened  by  demonstrating  the  use  of  the  con¬ 
traction  theory  approach  to  the  analysis  of  distributed  controllers.  Several  considerations 
that  could  be  addressed  are  including  the  effects  of  saturation,  the  convergence  properties 
when  collision  avoidance  mechanisms  are  added,  the  effects  of  delays  and  random  varying 
graphs,  etc.  Further  research  would  consider  linear  or  affine  transformation  for  convergence 
to  not  only  regular  formations,  and  the  use  of  the  convergence  primitive  tools  to  define  more 
complex  convergence  states. 

Reshaping  the  general  notion  of  convergence  to  the  more  general  sense  of  manifolds  (or 
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subspaces)  defines  a  new  dimension  to  the  widely  studied  consensus  problem.  There  might 
exist  applications  in  many  other  fields  where  the  distributed  system  objective  can  be  achieved 
without  convergence  to  the  ’common  agreement’  subspace  (  namely  M.  is  spanned  by  1)  but 
by  converging  to  some  more  general  ’coordination  subspace’  defined  as  h(x)  =  0. 

A  dual  of  the  control  problem  is  of  course,  the  estimation  problem.  The  application 
of  the  cyclic  approach  for  convergence  to  a  subspace,  can  be  defined  in  the  context  of  dis¬ 
tributed  sensors  that  are  required  to  converge  to  a  coordinated  estimate,  defined  by  a  linear 
transformation  of  the  overall  state. 

Chapter  7  presented  a  preliminary  study  of  options  that  can  be  applied  to  decentralize 
the  control  of  electromagnetic  formation  flight  systems.  Simulations  show  the  feasibility  of 
the  approaches.  A  deeper  and  more  complete  approach  to  theoretical  convergence  results 
and  control  design  are  possibilities  for  future  work. 

In  the  case  of  time  divided  resource  allocation,  the  design  of  the  controller  is  a  next 
step  to  be  addressed  which  should  take  into  account  the  intrinsic  disturbance  due  to  the 
non-complete  nature  of  the  approach  (  i.e.  the  desired  force  cannot  be  applied  instantly  but 
only  as  an  ’average’  over  a  cycle)  .  The  effects  in  performance  defines  a  clear  direction  for 
future  developments. 

Experimentation  of  the  time  based  and  frequency  based  allocation  could  be  feasible  on 
the  HTS  EMFF  testbed.  Resonant  frequencies  that  take  advantage  of  the  design  of  the  coils 
could  also  be  considered  as  future  developments. 

Finally,  hybrid  methods  that  use  time  based,  frequency  based  and  distributed  solution  of 
the  dipole  equation  can  have  important  advantages.  A  higher  level  analysis  that  can  identify 
the  most  advantageous  architectures  for  decentralized  EMFF  could  also  be  addressed,  as 
well  as  identifying  missions  that  would  truly  benefit  from  this  developments. 
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Appendix  A 


Mathematical  derivation  of  proofs 

A.l  C1Z  Matrices 

All  matrices  in  the  C1Z  have  the  same  set  of  linearly  independent  eigenvectors,  and  are 
diagonalizable  by  the  matrix  T  of  eigenvectors  VL®R,ij- 
Proof:  The  eigenvectors  of  L  ®  R  are  such  that 

VL®R,ij  =  vLi  <g>  uRj  (A.l) 

The  eigenvectors  of  L  are  the  same  for  all  circulant  matrices  L  which  following  Section  2.1.5 
are  shown  to  be  independent.  Equivalently,  the  eigenvectors  of  R  are  the  same  for  all  rotation 
matrix  R  that  share  an  axis  of  rotation  and  following  Section  2.1.4  are  shown  to  be  linearly 
independent.  Then,  the  set  of  eigenvectors  for  all  matrices  C7Z  which  are  described  as  L  ®  R 
is  linearly  independent.  The  Kronecker  composition  of  this  two  sets  of  linearly  independent 
vectors: 


=  (o,  o,  if  =  (o,  o,  i,  o,  o,  Xk,  ■  ■  . ,  o,  o,  xrT, 

fit  =i>k®  (l,j,0)r  =  (l,j,0,Xk,3Xk,0,  ■••,xr1,JXfc_1,0)T»  (A-2) 

iif  =  4>k®  (i, -j,  of  =  (i, -j,  o,  xk, -j  Xk,  o, . . . ,  XT\ -j  xr1.  °f> 
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where  k  €  {lf  i. .  ,n}  and  xpk  =  (l,Xk,xl,  ■  ■  ■  ,Xk  *)  >  where  Xk  =  e2nP/n,  k  E  {0, . . . ,  n  -  1} 
are  the  eigenvectors  of  L  (omitting  the  constant  1  /y/n).  The  composed  set  of  eigenvectors, 
can  then  be  verified  to  be  a  set  of  linearly  independent  eigenvectors  and  since  L  is  diag- 
onalizable,  R  is  diagonalizable,  then  all  CTZ  matrices  are  diagonalizable  by  a  matrix  T  of 
eigenvectors  vL(S)R ,  (See  Thm.  13.12  in  [41])  namely,  the  diagonal  matrix: 

(P-'LP)  ®  (Q-'RQ)  =  (P-1  ®Q-1)(L®R)(P®Q)  (A.3) 

-  {P®Q)~1(L®R)(P®Q)  (A. 4) 

where  P  is  a  matrix  of  eigenvectors  of  L  and  Q  is  a  matrix  of  eigenvectors  of  R.  ■ 


Therefore,  if  A,  B  E  C1Z 

eig (A  +  B)  =  eig(TAyiT'“1  +  TKBT~l) 

=  eig(T(AA  +  Ab)T-1)  (A. 5) 

where  Aa  is  a  diagonal  matrix  the  eigenvalues  of  A  AA)*  in  the  diagonal  (and  correspondingly 
the  same  holds  for  B).  Therefore  A A+B,i  —  A a,%  +  A^. 


We  also  have  then  that: 


AB  =  eig(TAAT-1TABr-1) 

=  eig(T(AAAB)T-1) 

-  eig(T(AsAA)T-1) 

=  BA  (A. 6) 
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A. 2  System  (3.10)  in  Polar  Coordinates 


Assume  that  ||pj||  =  ft  >  0.  Note  that  p,  =  giR(—'di)e i,  where  e\  is  the  first  vector  of  the 
canonical  basis,  i.e.,  t\  =  (1,  0)T.  Then,  we  can  write  pi+i  as 

Pi+i  =  —QiR(-0i+i)  ei  =  ei  =  ^R(di  -  0i+1)  Pi.  (A. 7) 

ft  Qi  Qi 

Moreover,  it  also  holds 

pjR(~f)Pi  =  ||Pi||2 cos('y)  =  ft2  cos (7),  for  any  7  e  M.  (A.8) 


First,  we  find  the  differential  evolution  for  the  magnitude  of  Pi,  i.e.,  for  ft.  We  have 

ft  =  =  —  pf  (#(ai+i)pi+i  -  i2(ai)pi).  (A. 9) 

dt  ]  I  Pi  1 1  Qi 

By  using  Eqs.  (A. 7)  and  (A.8)  we  then  obtain 


6i  =  -~pI (jK<* i+i)^-R(di  -  A+i)  Pi  -  -R(ai)Pi)  =  a cos((tfi+i  -  t?i)  -  Qj+1)  -  a cos(q() 

(A-10) 

We  now  find  the  differential  evolution  for  the  phase  of  p(,  i.e.,  for  ,dl.  Taking  time 
derivative  in  both  hands  of  the  identity  ftj  sin  Pi  —  pi  2  cos  d,;  =  0,  we  easily  obtain 


di  = 


Pi, 1  Pi, 2  ~Pi,2Pi,l 


^©P,  =  L2pJrQ  (-R(Q!i+l)Pi+l  -  i?(o!i)pi).  (A.ll) 


Then,  by  using  Eqs.  (A. 7)  and  (A.8)  we  obtain 


di  =  ^pjR(^j^R{ai+1)^-R('di-'di+1)pi-R(ai)pi^  =  sin((t?i+i-i9i)-a!i+i)+sin(ai). 

(A.12) 
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A. 3  Proof  of  Lemma  3.2.8 


Proof:  The  eigenvalues  of  P  are  solutions  to  the  characteristic  equation 


0  =  det  I 


\In  &  n  L\  ~\~  2ka  sn  In  sn  In 

6n  L- ^ 


(A-13) 


Note  that  both  matrix  (A In  —  anL  +  2 ka  sn  In)  and  matrix  —bn  L2  are  circulant;  then,  since 
circulant  matrices  form  a  commutative  algebra  (see  Section  2.1),  we  can  apply  the  result  in 
equation  (2.1)  and  obtain 


0 


det  ( XIn  on  L  T  2 ka  snIrfj(^XIn  cn  T)  -I-  snbnP  ^ 

det  ^A  In  ~j~  X^2ka  snIn  (ctn  T  0n)5^  2 kaSncnL  T  ( 'pncn  T  s^b^L 


=B 


det  ^X2In  +  \B  +  C^j 
det^A2/n  +  A5  +  B2 /A  —  S^j, 


(A- 14) 
(A.15) 

(A.16) 

(A.17) 


where  S  =  B2/4  —  C.  Note  that  B  and  C  are  circulant,  therefore  S  is  also  circulant.  Since  S 
is  circulant,  it  can  be  diagonalized  according  to  S  —  U  Ds  U*,  where  D$  is  a  diagonal  matrix 
with  the  eigenvalues  of  S  on  the  diagonal;  accordingly,  we  have  S1^2  =  U  DlJ2  U* .  Note 
that  B  and  S1'2  commute.  In  fact,  since  B  is  circulant,  it  can  be  diagonalized  via  the  same 
orthogonal  matrix  U:  B  =  U  DbU* ,  where  Ds  is  a  diagonal  matrix  with  the  eigenvalues  of 
B  on  the  diagonal;  hence 


S1/2B  =  UDl/2U*  UDbU*  =  UDl/2DBU*  =  UDBDlJ2U*  =  UDbU*  UD1s/2U*  =  B  S'172. 


Therefore,  we  have 

0  =  det  (x2Inxn+XB+B2 / 4—S^j  =  det  (a/„  -  (-5/2  +  v'S))  det  (xinxn  -  (-5/2  -  y/S)}  . 
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Hence,  the  eigenvalues  of  P  are  the  union  of  the  eigenvalues  of  ( —B/2  +  y/S)  and  [—Bj 2  — 
\[S).  Since  B  and  S1/2  are  diagonalized  by  the  same  similarity  transformation  U,  we  have 

-  y  ±  S1/2  =  U^-U*  ±  UDl/2U*  =  U  ±  DxJ2^j  U*.  (A.18) 

Let  A B,k  be  the  kth  eigenvalue  of  B,  and  A s,k  be  the  fcth  eigenvalue  of  S,  k  6  {1, . . .  ,n}. 
Then,  from  equation  (A.18),  we  have  that 

eig(P)  =  {Ab,i/2  ±  A$}V  (A.19) 

Hence,  we  are  left  with  the  task  of  computing  the  eigenvalues  of  B  and  S.  Such  eigenvalues 
can  be  easily  found  by  using  equation  (2.4): 

eig(£)  =  {2fcasn  +  (an  +  cn)(l-e27r^n)}”=i,  (A.20) 

eig(S)  =  {(A|>fc/4  -  Ac.fc}”=1  =  {(2^  +  (an  +  cn)(l  -  e2^)2/4 

.  ^(2&a sncn  T  ancn  T  sn6n)  (^2kasncn  C2cincn  T  2 snbn^jG  ^  ^ 

+  (ancn  +  bnsn)e4^n)Yk^.  (A. 21) 

We  first  consider  the  eigenvalues  of  B.  By  using  the  following  identities 

(1  —  eakj )  =  2sin(afc/2)e-J  ^  ,  (1  —  -(1  —  eJQfc ) )  =  cos(Q:jt/2)e■7a'^/,2,  (A. 22) 

Z 

and  after  some  algebraic  manipulations  omitted  for  brevity,  the  eigenvalues  of  B  can  be 
written  as 

A B,k  =  (2£:asn)  +  2(2cn  -  kasn)  sm(kTT /n)ej(-k7r/n~^\  k  G  {1, . . . ,  n}.  (A.23) 
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Hence,  we  have,  for  k  £  {1, ... ,  n}, 


Re(XB,k )  =  2kasn  +  2(2cn- kasn)  sin2 (kn/n),  (A.24) 

Im(\B,k)  =  —2(2cn  —  kasn)sm(kn/n)cos(kTr/n).  (A. 25) 

Next,  we  consider  the  eigenvalues  of  S.  By  using,  again,  the  identities  in  equation  (A. 22), 
and  with  simple  algebraic  manipulations,  we  can  write,  for  k  £  {1, . . . ,  n}, 

Xs,k  =  k2as2n(cos{kn/n)ejkn/n)2  +  (kasncn  +  s2n)(2sin(k-K/n)ej{kn/n~^)2 
=  [k?as2n  +  4 sin2(£;7r/n)  +  (4 kasncn  -  k2as2n  -  4c2)  sin2(jbr/n)]el2fclT/n. 

Notice  that  ka ,  cn  and  sn  are  positive  real  numbers;  then  the  term  inside  the  square  brackets 
is  a  positive  real  number.  Therefore  we  have,  for  k  £  {1, ... ,  n}, 

Re(\/Xs,k )  =  (&2s2  +  4sin2(£;7r/n)  +  {4ka.sncn  -  k2as2n  -  4c2)(sin2(Aur/n)))1/2  cos(kiT/n), 
which  can  be  rearranged  as 

Re(\/\st)  =  {(kasn  +  (2 cn  -  kasn)  sin2 (kn/n))2  +  4  sin2 (kn/n) (si  -  sin2(kn/n)))1/2 

—  ((Abj/2)2  4- 4sin2(A:7r/n)(s2  —  sin2(A:7r/n)))1'/2  .  (A. 26) 

From  equations  (A.24)  and  (A. 26)  it  is  straightforward  to  show  that 


•  For  k  =  n:  we  have 

Xp,n  Xg<n/2  'sj Xg  n  kasn  —  kasn  0. 
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•  For  k  =  1,  k  =  n  —  1: 


/m(v^)  =  &<*4cn  +  2a®, 
Ivni^-^J  Xgn—\)  kasncn  —  2sn. 


#e(x/A?a)  =  Re(  Ab,i/2)  =  (fcasn<£  +  2s^Cn), 
R& (  \/  ^S,n— 1 )  =  R&{^B,n— 1/2)  =  ( kaSnCn  +  2snCn), 

Therefore,  we  obtain 


-Re(Ap;1)  — 
/m(Ap)i)  = 

-Re(Ap,n_i)  = 
/m(AP,n_i)  = 


— i?e(Ap;i/2)  +  i?e(Apii/2)  —  0, 

(2cn  kasn)sncn  T  kasncn  T  2sn  2sn, 

— i?e(Apin_i/2)  +  /2e(Asin_i/2)  =  0, 

—  (20^“ kasn^sncn  kasncn  T  2sn —  2sn. 


•  For  1  <  fc  <  n  —  1,  since  sin(/c7r/n)2  >  sin(7r/n)2,  we  have: 

R,e(-\/Xsik)  <  Re{^B,k/2), 
and  thus  Re(Xp^)  <  0  for  k  £  {0,  l,n  —  1}. 


Now,  we  proceed  to  show  that  Vi,  v2,vs  in  lemma  3.2.8  are  the  eigenvectors  corresponding 
to  the  eigenvalues  0,  2 snj  and  —2 snj  respectively.  First,  consider  the  zero  eigenvalue.  Since 
L  ■  ln  =  0n  (where  0n  =  (0, 0, . . . ,  0)T  €  IRn),  it  is  easy  to  verify  that: 


Pv  i  = 


L  2ka  sn  In  sn  In 
bn  L  cn  L 


1 


n 


-2fcttl 


n 


—  (W 


(A. 27) 


Now,  consider  the  imaginary  eigenvalue  A2  =  2 snj.  By  replacing  v2  into  the  eigenvalue 
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equation  we  obtain 


dn  L  2ka  sn  In  sn  In  ip\  ijj\ 

2  snj 

bnL2  CnL  fn,2(ka)lpl  fn, 2{ka)^l 


(A. 28) 


Note  that  L  and  L2  (which  are  both  circulant  matrices)  satisfy,  respectively,  Lipi  =  (e27rj//"  — 
l)^i  =  (—2 snj(cn  +  jSn))^ i,  and  L2Vq  =  [e2n^n  —  l)2i>\  =  — 4s2 e27rj/nt/;i ;  hence,  v2  is  an 
eigenvector  for  P  if  and  only  if: 

(an(e27rj/n  -  1)  -  2kasn)ip\  +  26neWnsra^i  =  2snjrpl  (A.29) 

-4bnsl(cn  +jsn)2ipi  -  c„(-2sn;'(cn  +  jsn))26neJ7r/nV'i  =  -46neJ7r/nsnj0i  (A.30) 

By  using  the  identities  in  equation  (A. 22),  the  first  condition  can  be  verified  according  to 

2 sn(-cn  +  kasn)jejn/n  -  2 snka  +  2 snbnejir/n  =  2 snj, 

2 {{c„  -  kasn)j  -  ( ka  +  j){cn  -  jsn))e7rj/n  =  -2 bneJ*/n, 

-2(sn  +  kacn)e*j'n  =  -2  bne^n. 

Similarly,  the  condition  in  equation  (A.30)  can  be  verified  according  to 

-2  bns2n(cn  +  jsn )2  +  2cn(jsn(cn  +  jsn))bnejn/n  =  -2bnejn/nsnj, 

S-nipn  T  j^n)  Cnijipn  4“  j^n}')  ji 
j(4  +  cl)  =  3- 


Similar  arguments  hold  for  A3  and  v3  (which  are  complex  conjugates  of  X2  and  v2).  This 
concludes  the  proof.  ■ 
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A. 4  Proof  that  v.l  £  T(e*j(p*)M 


Proof:  It  is  enough  to  prove  that  at  least  one  of  the  components  of  G  ■  n,  is  nonzero. 
The  proof  that  G  ■  V\  ^  0  is  trivial.  We  proceed  to  show  that  Vgi  •  v2  7^  0,  i.e.: 


=  (Ve5i)  ■  +  (V^i) '  (-2 bne^'n^f)  ±  0. 


Both  terms  in  the  above  sum  can  be  shown  to  be  real  and  positive.  For  the  first  term  we 
have  that: 

n— 1 

(ye9i)  ■  =  cos(2nk/n)(cos(2nk /n)  +  j  sin(27r k/n)) 

k—0 

n— 1  n— 1  n—  1 

=  cos2(2fc7r/n)  +  j  2  sm(kTr/n )  =  ^  cos2(2A:7r/n)  G  M>0. 
k— 0  k= 0  k— 0 

For  the  second  term  we  have: 

n— 1  n 

(yvgi)  •  (-2 bne^n^)  =  EE  sm(2irk/n)2bnej7T/ne2wk/n 

k= 0  i=fc+l 

=  2bnYjake^k+l^j/n, 

k= 0 

where  Ofc  =  ^"=fc+1  sin(27ri/ro)  =  —  sui{2m/n).  Now  we  show  that  Ylk=o  ak^2k+1^^n  > 
0.  First,  consider  the  following  facts: 

Ofc  <  0  Vk, 

Ofc+ 1  =  ak  —  sin(2n(k  +  l)/n)  <  ak  for  0<k<n/2  —  1, 

«[(„- i)/2j  <  Ofc  T(n- l)/2], 

n—k  n 

on_fc  =  —  ^^sin(27rz/n)  =  ^  sin(27rm/n)  =  Ofc, 

i— 1  m=fc+l 
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ake^k+1)wj/n 

k= 0 


L(n-l)/2j 

J2  (ak^j/n  +  an.ke~k^n)  +  qa{n_1)/2 
k- 0 

L(n-1)/2J 

Y,  ak(enkj/n  +  e-k^n)  +  qain.  1)/2 

k= 0 


n— 1 

^  e(2fc+l)7rj/n  _ 
fc=0 


L(n-1)/2J 


J2  (enkj/n  +  e*~ki/n)  +q  =  0 


k= 0 


where  g  =  0  if  n  is  even.  Then, 

]P  =  0. 

k—0  k= 0 


Since  bn  =  (sn  +  fcacn)  >  0,  we  have  that  V^c/i  •  (—2 bne^^n)  G  M>o- 

The  proof  for  G-v3  7^  0  is  analogous;  in  particular,  it  requires  to  show  that  j  V^'V’i  £  R>o 
and  •  (— 2&ne-77r//""0i)  G  R>0- 


A. 5  Eigenvalues  of  the  projected  Laplacian 

The  derivation  of  the  eigenvalues  of  TZC^  Cm(a)(C^)TTZT  uses  the  properties  of  block- 
circulant  matrices,  specifically,  the  fact  that  they  all  belong  to  a  commutative  algebra.  We 
have  that: 

eig[7l,/:^)£sm(a)(£W)T^T]  =  eig[^T]eig[£W]eig[(£W)T]eig[£(a)  +  £»] 

=  eig[(/n  ®  R(ir/N))(In  <g>  J2T(7r/iV))] 

xeig[(Li  ®  h){L[  ®  J3)]eig[£(a)  +  £(a)T] 

=  eig[(Lx  ®  h )(Lj  ®  /3)]eig[£(a)  +  £(a)T] 
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Then 


eig[lZC£smjC.T1ZT] 
X ik 


—  \k  i  ^  {1,  N},  k  G  {— 1,  0, 1} 

_  ^  _  e-j2imv/N')^  _  ej2imn/N^^ejka  _  ejka-j2imir/N ^  jka  _  e~jka+j2iw/N ^ 

=  (2  —  e~i2™lN  —  ej2lff/W)2(cos(£;a:)  —  cos(A;a:  —  2irmr/N)) 

=  4(1  —  cos(2in/N))(cos(ka)  —  cos(/ca  —  2imir/N))  (A. 31) 


Then,  for  i  =  1: 


(1  —  cos(2*7r  /N))  =  0 

^ifc  =  0 


for  i  =  N: 


(cos  (ka)  —  cos  (ka  —  2mm /N))  =  0  =$■  X^k  =  0 

otherwise  for  1  <  %  <  N,  \a\  <  2 n/N  : 

(cos  (ka)  —  cos  (ka  —  2imn/N))  >  0 
(1  —  cos(2m/N))  >  0 


Proposition  A. 5.1 

Vrncsmvjn  =  K„7^£(a)£sm£(a)T^iC  >  0  ,  (A.32) 

Proof:  TZT,C(a)jOsmjC(a)T  is  a  symmetric  matrix,  then,  its  nullity  is  the  algebraic 
multiplicity  of  the  0  eigenvalue.  Thus,  dim{J\f  (7lrtC(a)£smC(a)TTZfl)}  =  6.  On  the  other 
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hand,  the  dimension  of  Kn (7Zri£(a)  £srn£(a:)T  7Zj} ) Kj  —  3N  —  6,  and  thus  it  is  full  rank. 
Since  {TZV£{ a ) £ sm £(a)T )  is  positive  semidefinite,  then  Vrn£smV^n  is  at  least  positive 
semidefinite,  but  since  it  is  full  rank,  the  proposition  is  proven.  ■ 
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